hk349 gmm/Gaussian mixture model and pupil tracking
. The second operating system prepared by Shi Lei is based on the calculation method of GMM/Gaussian hybrid model and is mainly used to develop speech systems.
The so-called high-form mixed model is a model that uses a Gaussian probability density function to accurately quantify transactions and decompose a transaction into several Gaussian probability density functions, that is, a normal distribution curve.
The GMM model is usually used for speech recognition and has been widely used in the computer field. Although the speech recognition produced by the GMM model will have an error recognition rate of about 20-30%, as long as the speech is standard enough and cooperates with the behavioral dynamic recognition engine
By monitoring lip reading, this false recognition rate will be greatly reduced.
Lip behavior dynamics in lip language can be completely captured and successfully recognized through the behavioral dynamic recognition engine. As for whether the voice command is standard enough, that is beyond Shi Lei's control. After all, dialects vary from place to place and can only be based on Mandarin as the standard.
Shi Lei can definitely respond. If you want to play "World of Brave" well, you must speak standard Mandarin. Maybe with the popularity of "World of Brave", there will be a wave of learning Mandarin in Xia Kingdom.
!
If this is the case, "World of Brave" may be officially recommended by Xia Guo. If it can be officially recommended, then "World of Brave" will definitely flourish!
The GMM Gaussian mixture model is not complicated. In natural language processing, it is just a shallow learning neural network. In 2006, a professor from the University of Toronto in Canada published an article titled
Academic paper, which introduces the problem of deep learning neural networks. Many hidden layer artificial neural networks have excellent feature learning capabilities, and the learned features have a more essential description of the data. This is the deep learning neural network corresponding to the shallow learning neural network.
Learn neural networks.
Before Shi Lei was reborn, in 2012, Stanford University and a large-scale computer system expert jointly used 16,000 Core.CPUs to build a model called Deep.Neural.Networks/deep neural network.
Simultaneous translation into Xia Mandarin, the translation process is very smooth, there is no lag at all, and the error rate is less than 1%!
The pseudo-artificial intelligence of the Angel Council is built using the DNN deep neural network model!
Unfortunately, Shi Lei does not have time to develop a deep neural network model based on DNN. He can only make a shallow neural network based on GMM to make a speech recognition system, and then use a behavioral dynamic recognition engine to identify lip language solutions to reduce the recognition error rate.
Regarding the voice system, after it is developed, it can not only be used in "World of Brave", but can also be applied in many aspects.
Especially when combined with the behavioral dynamic recognition engine, it becomes a very powerful system. With the speech recognition system, Shi Lei can control the computer with his voice.
When the time comes, Shi Lei can even simulate the attack of two people by himself, or he can fight with himself to better conceal his identity.
There are also some monitoring systems that can achieve better results. For example, in medical monitoring systems, some patients who cannot move can speak. Then such patients can operate the medical system through voice, call nurses or doctors, etc.
Serve.
Regarding the voice system based on GMM, Shi Lei has another idea in his mind, that is
Returning to the theme of developing "World of Brave", with the help of a behavioral dynamic recognition engine and the GMM voice system, a true somatosensory game can be formed.
As for another difficulty, the problem of the character action system, Shi Lei plans to develop a third auxiliary operating system. That is to use a behavioral dynamic recognition engine to specifically track the player's pupils, and then use software calculations to determine the focus of the player's sight.
As for pupil tracking technology, it has not yet been patented in this era, and Shi Lei can just take over this technology. The original patentee of this technology was Nokia, but it is a pity that Nokia declined in later generations and was completely killed by Android.
Pupil tracking technology has many benefits when applied in "World of Brave". Combined with the behavioral dynamic recognition engine and GMM voice system, it can perfectly realize some difficult somatosensory operations.
For example, Qinggong is a somatosensory operation that is absolutely impossible for players to achieve in reality. To give an example, if the player is on a cliff and wants to use Qinggong to fly down.
At this time, using somatosensory operations, it is impossible to find a place to jump, right? Therefore, pupil tracking technology can be applied. Using pupil tracking technology, and then using small jumping movements, you can jump off the cliff.
As for the various footholds on the cliff, the player's focus line of sight needs to be determined, and then based on pupil tracking technology, the characters in the game can be controlled accordingly.
To give another example, for example, in "World of Brave", throwing knives or attacking with bows and arrows, as well as throwing other hidden weapons, although players can easily perform these actions, they can't just throw them in any direction, right?
If you throw in one direction and use a dynamic recognition engine based on behavior, you can force the target to be determined, but what about when facing multiple targets? Then you will be powerless!
If you have pupil tracking technology, you can calculate the visual focus by judging the pupil line of sight, thereby confirming which game target is locked, so as to facilitate accurate attacks.
Counting pupil tracking technology, "World of Brave" has introduced three sets of operation methods. These three sets of operation methods combined together will form a perfect game control scheme.
In 2007, January 1st, New Year's Day, at around five o'clock in the afternoon, Shi Lei completed the foundation of the GMM model. As for the pupil tracking technology and lip reading technology, the behavior dynamic recognition engine can be used to change the strategy.
way to directly implement this technology.
After standing up from the chair and stretching, Shi Lei walked out of the bedroom and prepared to find something to eat in the refrigerator.
Due to the development of the GMM model and the production of the speech system, Shi Lei simply ate something to satisfy his hunger during lunch. As a foodie, Shi Lei's hunger tolerance attribute is definitely close to zero. He is hungry now and needs to find something.
eat.
When I opened the refrigerator, I saw that it was empty because it had not been replenished for a long time. There was no milk at all!
"Shit!" Shi Lei couldn't help complaining, "Damn it, aren't you going to starve to death?"
Shi Lei returned to the bedroom, grabbed the car keys on the computer table, and was about to go out to eat and buy some supplies. But as soon as he walked out of the door, the phone in his pants pocket rang.
The caller ID was Ouyang Xiang. Shi Lei looked happy and quickly pressed the connect button.
"Hey, Happy New Year, Ouyang!" Shi Lei said first.
Ouyang Xiang's voice was firm and powerful, with a bright and clear voice, "Shi Lei, Happy New Year. Are you in Jingyayuan?"
"Well, I'm here!" Shi Lei responded. He suddenly remembered that Ouyang Xiang seemed to be alone in Jingyayuan. Ouyang Xiang's father died early, and she seemed to have a very bad relationship with her mother.
"Shi Lei, come over for dinner later!" Ouyang Xiang's voice was filled with concern and a touch of joy.
Shi Lei was happy and secretly guessed why Ouyang Xiang suddenly called him over for dinner. Although the relationship between the two of them had eased because Shi Lei took the initiative to let Ouyang Xiang work in the anti-narcotics team.
But Shi Lei always came to the door shamelessly, and Ouyang Xiang never mentioned it on his own initiative.
Although I couldn't figure out why Ouyang Xiang took the initiative to ask him to have a meal, how could Shi Lei let it go if there was such a good thing as having a meal?
"Ah, Ouyang, you are so kind. I love you so much. I will come over right away!" Shi Lei said quickly on the phone.
Ouyang Xiang snorted, "Don't be such a talker, come if you want!" After saying that, Ouyang Xiang hung up the phone directly.
Shi Lei walked into the elevator humming a tune, and the phone in his hand rang again. Shi Lei thought it was Ouyang Xiang, but when he was about to answer the call, he saw it was Li Zhiyue!
This discovery shocked Shi Lei. He was just about to have a few words with Ouyang Xiangkou after the call was connected.
‘Nah, ah, ah, be sure to check the caller ID before you answer the phone next time!’ It almost led to a big mistake, which made Shi Lei break into a cold sweat on his forehead.
Taking a deep breath, Shi Lei answered the phone and said as calmly as possible: "Zhiyue, happy New Year's Day!"
Li Zhiyue responded, "Shi Lei, Happy New Year."
Shi Lei knew that if nothing happened, it would be impossible for Li Zhiyue to take the initiative to call him. Especially in this life, Li Zhiyue had not been disfigured and was not under psychological pressure. It was even less likely that she would take the initiative to call him.
Since Li Zhiyue took the initiative to call, it means that Li Zhiyue must have something to do, "Zhiyue, how are you lately?"
Li Zhiyue responded absently: "It's okay."
Shi Lei could tell that Li Zhiyue was not in the mood for small talk. He knew Li Zhiyue very well, so he took the initiative to ask: "Zhiyue, do you have anything to do with me?"
"I" Li Zhiyue's tone was full of hesitation, "I"
Shi Lei was a little anxious, "Zhiyue, what is going on? Is that Wu Bin coming to harass you again?" The Wu Bin that Shi Lei mentioned was a calligraphy teacher at the Art Department of Shuangqing University. He was only 28 years old and was studying at Shuangqing University.
He can be said to be young and promising. He once visited Li Zhiyue's home and was originally deeply loved by Li Zhiyue's mother Huang Fen.
Li Zhiyue denied: "It's not Wu Bin! He's not harassing me now."
"What's that, Zhiyue? If anything happens, just tell me! No matter what it is, I will help you!" Shi Lei asked anxiously.
In the previous life, there was an ever-lasting bond between Shi Lei and Li Zhiyue. Their platonic love, no matter how long the time gap was, Shi Lei would still never forget it even if they were reborn!
In this life, because he saw Li Zhiyue again and saw the flawless Li Zhiyue, Shi Lei fell in love with her even more!
Li Zhiyue was silent and did not speak.
"Zhiyue, if you don't tell me, I will go to your home right now!" Shi Lei couldn't help but ask a little more forcefully.
(To be continued. Please search Piaotian Literature, the novel will be better and updated faster!)
