Нажмите "Enter", чтобы перейти к контенту

Школьник из России выиграл конкурс Google за разработку переводчика с языка жестов

Можно ли помочь глухонемым людям выразить свои мысли, автоматически переводя жесты руками, которые они показывают, в слова? Таким вопросом задался российский десятиклассник Даниил Казанцев из Екатеринбургского лицея. Решение разобраться в этой проблеме привело Даниила к победе в одной из категорий конкурса молодых ученых Google Science Fair 2019. Он разработал систему, которая может интерпретировать язык жестов и заменять сурдопереводчика.

Школьник из России выиграл конкурс Google за разработку переводчика с языка жестов

Как указано на сайте конкурса Google, Казанцев прошел отбор среди тысяч других участников конкурса и стал одним из 24 финалистов из 14 стран мира. В итоге он получил премию Lego Education Builder за разработку своего переводчика языка жестов.

Школьник из России выиграл конкурс Google за разработку переводчика с языка жестов Все финалисты конкурса. Даниил крайний слева

ActionTeaser.ru — тизерная реклама

Что такое электромиография?

В основе разработки юного российского гения лежит технология электромиографии, которая определяет электромеханическую активность мышц с учетом изменяющегося положения руки и пальцев. В этом случае каждое движение конечности создает крошечные электрические сигналы, которые можно считать, а затем перевести в понятные для компьютера команды. В частности, эта технология используется для управления искусственными протезами.

Читайте также: Как немые люди могут вновь обрести дар речи?

Но российский школьник разработал на основе технологии электромиографии систему, которая может переводить электрические сигналы мышц в слова.

Школьник из России выиграл конкурс Google за разработку переводчика с языка жестов Синими и белыми крестиками обозначены места расположения электродов, которые считывают электрические импульсы мышц

Как работает переводчик языка жестов

Устройство состоит из манжеты, которая надевается на предплечье. На манжете установлены 24 электрода, каждый из которых считывает определенные электрические сигналы мышц предплечья. Кроме того, здесь используется специальный датчик, который определяет положение предплечья в пространстве. На базе всех этих сигналов формируется уникальный «отпечаток» положения каждой отдельной части кисти в пространстве.

Школьник из России выиграл конкурс Google за разработку переводчика с языка жестов

Школьник из России выиграл конкурс Google за разработку переводчика с языка жестов

Все собираемые сигналы усиливаются и фильтруются от лишнего электромагнитного шума, а затем по проводам передаются на внешний микрокомпьютер. Этот микрокомпьютер оцифровывает сигналы с датчиков и электродов, после чего передает их в мощный вычислительный сервер со специально обученной нейросетью. Именно с помощью нейросети проводится интерпретации (перевод в слова) данных об электрических сигналах, отвечающих за каждый языковой жест.

Как проводилась проверка переводчика жестов

Проверку системы Даниил проводил на себе и двух других добровольцах. В качестве основы для перевода он использовал 5 жестов и популярного жестового языка ASL (American Sign Language).

Школьник из России выиграл конкурс Google за разработку переводчика с языка жестов Hello (привет); Yes (да); No (нет); Please (пожалуйста); I love you (я люблю тебя)

Для проверки эффективности системы для каждого распознавания жеста использовалось 10 попыток. Как указывает автор разработки, система смогла показать 92,6-процентную точность при распознавании.

Школьник из России выиграл конкурс Google за разработку переводчика с языка жестов В таблице отмечены участники эксперимента, наименования жестов, которые требуется распознать системе, а также количество верных распознаваний

Видео проверки технологии можно посмотреть ниже:

Школьник из России выиграл конкурс Google за разработку переводчика с языка жестов

Школьник из России выиграл конкурс Google за разработку переводчика с языка жестов

Даниил отмечает, продолжит работу над автономным сурдопереодчиком. Есть несколько моментов, которые пока не позволяют использовать его в качестве готового решения. Например, сейчас система может переводить только отдельные жесты. Но пока не способна формировать из полученных слов предложения. Таким образом сейчас систему нельзя использовать в качестве полной замены сурдопереводчика. Решение этого вопроса станет одной из будущих задач юного ученого.

Читайте также: Эта нейросеть знает, как вы будете выглядеть через 50 лет. Как она работает?

Кроме того, электронный сурдопереводчик требует постоянного доступа к мощному вычислительному серверу с нейросетью, которая производит распознавание сигналов языковых жестов и переводит их в слова. Однако автор отмечает, что современная скорость передачи данных по мобильному интернету позволяет обеспечить постоянный доступ к серверу, тем самым частично компенсируя этот недостаток. Автор также рассматривает возможность сделать устройство более компактным, уменьшив площадь расположения электродов до 7 сантиметров.

В целом отмечается, что при доработке такой технологии, ее можно будет использовать с любым жестовым словарем. При этом от пользователя не потребуется никакой специальной подготовки для возможности использования такой системы.

Более подробно с разработкой Даниила Казанцева можно ознакомиться на странице его проекта.

Если вам интересны новости науки и технологий, подпишитесь на наш канал в Яндекс.Дзен. Там вы найдете эксклюзивные материалы, которые не были опубликованы на сайте!

Источник: news-ria.ru

53 комментария

  1. Can I just state what a relief to find someone who actually understands what theyre talking about on the web. You absolutely recognize just how to bring a problem to light and also make it important. More individuals require to read this and recognize this side of the story. I angle think youre not a lot more prominent since you most definitely have the present.

  2. tooth root tooth root 01.10.2020

    Hey I know this is off topic but I was wondering if you knew of any widgets I could add to my blog that automatically tweet my newest twitter updates. I’ve been looking for a plug-in like this for quite some time and was hoping maybe you would have some experience with something like this. Please let me know if you run into anything. I truly enjoy reading your blog and I look forward to your new updates.

  3. kids smile kids smile 01.10.2020

    Hello there! Would you mind if I share your blog with my zynga group? There’s a lot of people that I think would really appreciate your content. Please let me know. Thanks

  4. rdh rdh 02.10.2020

    This design is incredible! You most certainly know how to keep a reader entertained. Between your wit and your videos, I was almost moved to start my own blog (well, almost…HaHa!) Excellent job. I really loved what you had to say, and more than that, how you presented it. Too cool!

  5. tooth filling cost tooth filling cost 02.10.2020

    Hey I know this is off topic but I was wondering if you knew of any widgets I could add to my blog that automatically tweet my newest twitter updates. I’ve been looking for a plug-in like this for quite some time and was hoping maybe you would have some experience with something like this. Please let me know if you run into anything. I truly enjoy reading your blog and I look forward to your new updates.

  6. Hello! Quick question that’s entirely off topic. Do you know how to make your site mobile friendly? My web site looks weird when browsing from my iphone 4. I’m trying to find a template or plugin that might be able to fix this problem. If you have any suggestions, please share. Thank you!

  7. tooth crown tooth crown 04.10.2020

    I know this if off topic but I’m looking into starting my own blog and was curious what all is needed to get setup? I’m assuming having a blog like yours would cost a pretty penny? I’m not very web savvy so I’m not 100 certain. Any tips or advice would be greatly appreciated. Thank you

  8. broken tooth broken tooth 04.10.2020

    Good day! This post could not be written any better! Reading this post reminds me of my old room mate! He always kept chatting about this. I will forward this post to him. Pretty sure he will have a good read. Many thanks for sharing!

  9. e max e max 04.10.2020

    Cool blog! Is your theme custom made or did you download it from somewhere? A theme like yours with a few simple tweeks would really make my blog shine. Please let me know where you got your theme. Thank you

  10. Having read this I believed it was extremely enlightening. I appreciate you taking the time and energy to put this article together. I once again find myself personally spending a significant amount of time both reading and leaving comments. But so what, it was still worthwhile!

  11. alat laboratorium alat laboratorium 05.10.2020

    Way cool! Some extremely valid points! I appreciate you writing this write-up and the rest of the site is really good.

  12. Having read this I thought it was extremely informative. I appreciate you finding the time and energy to put this content together. I once again find myself spending a lot of time both reading and posting comments. But so what, it was still worthwhile!

  13. tooth extraction tooth extraction 05.10.2020

    Right now it seems like WordPress is the top blogging platform available right now. (from what I’ve read) Is that what you are using on your blog?

  14. Rickey Eger Rickey Eger 07.10.2020

    I have been surfing online greater than three hours these days, but I never discovered any attention-grabbing article like yours. It’s lovely value enough for me. Personally, if all webmasters and bloggers made just right content as you probably did, the internet can be much more helpful than ever before.

  15. Tawna Stupp Tawna Stupp 07.10.2020

    childrens clothing should be as comfortable as possible that is why the choice of fabric is also critical-

  16. Larry Buff Larry Buff 07.10.2020

    Needed to draft you the bit of note to be able to thank you again just for the breathtaking pointers you’ve shared at this time. It is certainly incredibly open-handed with people like you to supply easily precisely what a lot of folks would’ve offered as an e book to help make some bucks on their own, notably now that you could have done it in case you decided. The tricks additionally served to become good way to recognize that some people have a similar interest the same as my own to learn many more concerning this problem. I am sure there are a lot more enjoyable periods ahead for many who scan through your blog.

  17. Beulah Homewood Beulah Homewood 08.10.2020

    Thanks i love your article about Catholic Priests and Former Abortionist Confront Congress on Meaning of “Abortion” | Fr. Frank Pavone’s Blog

  18. cbd for pain cbd for pain 17.10.2020

    There are certainly a lot of details like that to think about. That is a great indicate raise. I provide the thoughts over as general ideas but clearly there are questions like the one you bring up where one of the most important point will be working in straightforward good faith. I don?t understand if ideal methods have actually arised around things like that, however I make sure that your task is plainly recognized as an up for grabs. Both children and ladies feel the impact of just a moment?s pleasure, for the remainder of their lives.

  19. security doors security doors 22.10.2020

    Do you have a spam problem on this site; I also am a blogger, and I was wondering your situation; we have created some nice procedures and we are looking to trade methods with other folks, please shoot me an email if interested.

  20. security screens security screens 23.10.2020

    I love your blog.. very nice colors & theme. Did you design this website yourself or did you hire someone to do it for you? Plz respond as I’m looking to design my own blog and would like to find out where u got this from. appreciate it

  21. I’m curious to find out what blog platform you have been working with? I’m having some minor security problems with my latest site and I would like to find something more risk-free. Do you have any suggestions?

  22. We stumbled over here by a different web address and thought I may as well check things out. I like what I see so i am just following you. Look forward to looking into your web page repeatedly.

  23. Nora Castanada Nora Castanada 27.10.2020

    Oh my goodness! an amazing post guy. Thanks However I am experiencing issue with ur rss. Don?t know why Incapable to register for it. Is there any person getting the same rss trouble? Anybody that understands kindly react. Thnkx

  24. digital agencies digital agencies 28.10.2020

    Hi terrific website! Does running a blog similar to this take a large amount of work? I’ve no knowledge of programming however I was hoping to start my own blog soon. Anyhow, if you have any suggestions or techniques for new blog owners please share. I know this is off topic however I simply needed to ask. Appreciate it!

  25. This design is incredible! You definitely know how to keep a reader amused. Between your wit and your videos, I was almost moved to start my own blog (well, almost…HaHa!) Great job. I really enjoyed what you had to say, and more than that, how you presented it. Too cool!

  26. rolling shutters rolling shutters 02.11.2020

    Hello! This is my first visit to your blog! We are a group of volunteers and starting a new project in a community in the same niche. Your blog provided us beneficial information to work on. You have done a extraordinary job!

  27. james kerr james kerr 03.11.2020

    Hi! I could have sworn I’ve been to this blog before but after checking through some of the post I realized it’s new to me. Anyhow, I’m definitely delighted I found it and I’ll be bookmarking and checking back often!

  28. vista screens vista screens 03.11.2020

    Howdy! I’m at work surfing around your blog from my new iphone! Just wanted to say I love reading through your blog and look forward to all your posts! Keep up the great work!

  29. james kerr james kerr 03.11.2020

    Have you ever thought about writing an ebook or guest authoring on other sites? I have a blog centered on the same subjects you discuss and would really like to have you share some stories/information. I know my viewers would enjoy your work. If you’re even remotely interested, feel free to send me an e mail.

  30. security doors security doors 04.11.2020

    Good day! This post could not be written any better! Reading through this post reminds me of my previous room mate! He always kept chatting about this. I will forward this page to him. Pretty sure he will have a good read. Thanks for sharing!

  31. crimsafe crimsafe 04.11.2020

    With havin so much content do you ever run into any issues of plagorism or copyright infringement? My website has a lot of exclusive content I’ve either created myself or outsourced but it seems a lot of it is popping it up all over the internet without my permission. Do you know any solutions to help stop content from being stolen? I’d truly appreciate it.

  32. elena ledoux elena ledoux 04.11.2020

    Hi there! This is kind of off topic but I need some help from an established blog. Is it hard to set up your own blog? I’m not very techincal but I can figure things out pretty fast. I’m thinking about making my own but I’m not sure where to begin. Do you have any ideas or suggestions? Cheers

  33. I enjoy what you guys tend to be up too. This sort of clever work and coverage! Keep up the terrific works guys I’ve you guys to our blogroll.

  34. Fascinating blog! Is your theme custom made or did you download it from somewhere? A design like yours with a few simple tweeks would really make my blog jump out. Please let me know where you got your design. Appreciate it

  35. Hey are using WordPress for your blog platform? I’m new to the blog world but I’m trying to get started and create my own. Do you need any coding expertise to make your own blog? Any help would be really appreciated!

  36. screen masters screen masters 05.11.2020

    Hey there! I know this is kinda off topic however I’d figured I’d ask. Would you be interested in trading links or maybe guest writing a blog post or vice-versa? My blog addresses a lot of the same subjects as yours and I think we could greatly benefit from each other. If you are interested feel free to shoot me an e-mail. I look forward to hearing from you! Wonderful blog by the way!

  37. Greetings from Colorado! I’m bored at work so I decided to check out your website on my iphone during lunch break. I enjoy the information you present here and can’t wait to take a look when I get home. I’m shocked at how quick your blog loaded on my phone .. I’m not even using WIFI, just 3G .. Anyhow, very good blog!

  38. Heya this is kind of of off topic but I was wanting to know if blogs use WYSIWYG editors or if you have to manually code with HTML. I’m starting a blog soon but have no coding know-how so I wanted to get advice from someone with experience. Any help would be greatly appreciated!

  39. Amazing blog! Do you have any tips and hints for aspiring writers? I’m hoping to start my own website soon but I’m a little lost on everything. Would you suggest starting with a free platform like WordPress or go for a paid option? There are so many choices out there that I’m totally overwhelmed .. Any tips? Bless you!

  40. Have you ever thought about adding a little bit more than just your articles? I mean, what you say is valuable and everything. However think of if you added some great photos or videos to give your posts more, «pop»! Your content is excellent but with images and video clips, this blog could undeniably be one of the most beneficial in its niche. Wonderful blog!

  41. When I originally commented I clicked the «Notify me when new comments are added» checkbox and now each time a comment is added I get several emails with the same comment. Is there any way you can remove people from that service? Appreciate it!

  42. screen masters screen masters 07.11.2020

    Write more, thats all I have to say. Literally, it seems as though you relied on the video to make your point. You obviously know what youre talking about, why waste your intelligence on just posting videos to your blog when you could be giving us something enlightening to read?

  43. Hey there! This is my first visit to your blog! We are a collection of volunteers and starting a new project in a community in the same niche. Your blog provided us valuable information to work on. You have done a extraordinary job!

  44. Hello great website! Does running a blog like this require a lot of work? I’ve virtually no knowledge of coding but I had been hoping to start my own blog in the near future. Anyways, if you have any recommendations or techniques for new blog owners please share. I know this is off subject but I just wanted to ask. Thanks!

  45. Howdy! Do you know if they make any plugins to assist with Search Engine Optimization? I’m trying to get my blog to rank for some targeted keywords but I’m not seeing very good gains. If you know of any please share. Thank you!

  46. security dog doors security dog doors 24.11.2020

    Hi, I think your website might be having browser compatibility issues. When I look at your blog site in Ie, it looks fine but when opening in Internet Explorer, it has some overlapping. I just wanted to give you a quick heads up! Other then that, excellent blog!

Добавить комментарий

Ваш e-mail не будет опубликован.

3 × 1 =