{"id":12701,"date":"2021-12-23T15:31:05","date_gmt":"2021-12-23T14:31:05","guid":{"rendered":"https:\/\/www.teoresigroup.com\/?post_type=thesis&#038;p=12701"},"modified":"2022-01-26T15:52:52","modified_gmt":"2022-01-26T14:52:52","slug":"nrppg-nnet-entoend-deep-learning-approach-to-remote-hearrate-estimation-through-spatial-temporal-representation","status":"publish","type":"thesis","link":"https:\/\/www.teoresigroup.com\/de\/thesis\/nrppg-nnet-entoend-deep-learning-approach-to-remote-hearrate-estimation-through-spatial-temporal-representation\/","title":{"rendered":"NrPPG-NNET: an End to End Deep Learning Approach to Remote Heart Rate Estimation Through Spatial-Temporal Representation"},"content":{"rendered":"\n<div class=\"wp-block-columns align-center row sezione\">\n<div class=\"wp-block-column small-12 medium-10 large-8\">\n<h5 class=\"has-text-align-center wp-block-heading\">Abstract<\/h5>\n\n\n\n<p>This research describes the development of a deep learning approach for remote non-contact heart rate estimation.<br>Research question: Does video footage of a human convey enough graphic information to accurately estimate clinical parameters?<br>In the proposed work, we try to answer this question by building an end-to-end system that receives images (or frames) as input and produces the predicted HR estimation.<br>The field of non-contact HR detection is vast, therefore all previously proposed methods are investigated and analyzed. The proposed deep learning approach is called NrPPG-NNET and was developed by applying the knowledge of a previously trained Convolutional Neural Network for image recognition and retrained to resolve this new task. NrPPG-NNET T achieves competitive results in terms of bpm Mean Absolute Error and is significantly lighter than most of the previously proposed methods, moreover, it can be run in real-time on mid-range laptops (even without GPU). Thanks to its speed and ease of use, NrPPG-NNET could potentially find application in the field of human-computer interaction and clinical monitoring. In addition, during development clues that are important for future work and provide a solid foundation for further research have emerged.<\/p>\n\n\n\n<h5 class=\"has-text-align-center wp-block-heading\">Objectives<\/h5>\n\n\n\n<p>Development of a model for heart rate prediction based on artificial intelligence, taking a video as input from which frames are extracted and later pre-processed in order to obtain a proper dataset for the neural network responsible for the estimate of the heartbeat.<\/p>\n\n\n\n<h5 class=\"has-text-align-center wp-block-heading\">Research methodology<\/h5>\n\n\n\n<p>Video preprocessing for space-time mapping. Development and training of a neural network and subsequent model validation.<\/p>\n\n\n\n<h5 class=\"has-text-align-center wp-block-heading\">Conclusions<\/h5>\n\n\n\n<p>A heartbeat prediction model has been realized. The model achieves good results and is now in line with the state of the art.<\/p>\n\n\n\n<h5 class=\"has-text-align-center wp-block-heading\">Future developments<\/h5>\n\n\n\n<p>Testing different datasets and improvement of the current model.<\/p>\n<\/div>\n<\/div>\n","protected":false},"featured_media":0,"template":"","university":[244],"thesis_type":[272,274,254],"keyword":[241,243,242,240,187,239],"class_list":["post-12701","thesis","type-thesis","status-publish","hentry","university-universita-di-utrecht-de","thesis_type-artificial-intelligence-de","thesis_type-deep-learning-de","thesis_type-python-de","keyword-ai","keyword-computer-vision","keyword-deep-learning","keyword-heart-rate-contactless-prediction","keyword-python","keyword-pytorch"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.6 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>NrPPG-NNET: an End to End Deep Learning Approach to Remote Heart Rate Estimation Through Spatial-Temporal Representation - Teoresi Group<\/title>\n<meta name=\"description\" content=\"Discover all you need to know about NrPPG-NNET: an End to End Deep Learning Approach to Remote Heart Rate Estimation Through Spatial-Temporal Representation on Teoresi Group - Teoresi Group is high profile engineering. It offers an innovative approach in close synergy with the Research and Development departments of the main industrial players.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.teoresigroup.com\/de\/thesis\/nrppg-nnet-entoend-deep-learning-approach-to-remote-hearrate-estimation-through-spatial-temporal-representation\/\" \/>\n<meta property=\"og:locale\" content=\"de_DE\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"NrPPG-NNET: an End to End Deep Learning Approach to Remote Heart Rate Estimation Through Spatial-Temporal Representation - Teoresi Group\" \/>\n<meta property=\"og:description\" content=\"Discover all you need to know about NrPPG-NNET: an End to End Deep Learning Approach to Remote Heart Rate Estimation Through Spatial-Temporal Representation on Teoresi Group - Teoresi Group is high profile engineering. It offers an innovative approach in close synergy with the Research and Development departments of the main industrial players.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.teoresigroup.com\/de\/thesis\/nrppg-nnet-entoend-deep-learning-approach-to-remote-hearrate-estimation-through-spatial-temporal-representation\/\" \/>\n<meta property=\"og:site_name\" content=\"Teoresi Group\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/pages\/Gruppo-Teoresi\/118393464917205\" \/>\n<meta property=\"article:modified_time\" content=\"2022-01-26T14:52:52+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.teoresigroup.com\/wp-content\/uploads\/2021\/02\/og-image.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Gesch\u00e4tzte Lesezeit\" \/>\n\t<meta name=\"twitter:data1\" content=\"1\u00a0Minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.teoresigroup.com\\\/de\\\/thesis\\\/nrppg-nnet-entoend-deep-learning-approach-to-remote-hearrate-estimation-through-spatial-temporal-representation\\\/\",\"url\":\"https:\\\/\\\/www.teoresigroup.com\\\/de\\\/thesis\\\/nrppg-nnet-entoend-deep-learning-approach-to-remote-hearrate-estimation-through-spatial-temporal-representation\\\/\",\"name\":\"NrPPG-NNET: an End to End Deep Learning Approach to Remote Heart Rate Estimation Through Spatial-Temporal Representation - Teoresi Group\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.teoresigroup.com\\\/it\\\/#website\"},\"datePublished\":\"2021-12-23T14:31:05+00:00\",\"dateModified\":\"2022-01-26T14:52:52+00:00\",\"description\":\"Discover all you need to know about NrPPG-NNET: an End to End Deep Learning Approach to Remote Heart Rate Estimation Through Spatial-Temporal Representation on Teoresi Group - Teoresi Group is high profile engineering. It offers an innovative approach in close synergy with the Research and Development departments of the main industrial players.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.teoresigroup.com\\\/de\\\/thesis\\\/nrppg-nnet-entoend-deep-learning-approach-to-remote-hearrate-estimation-through-spatial-temporal-representation\\\/#breadcrumb\"},\"inLanguage\":\"de\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.teoresigroup.com\\\/de\\\/thesis\\\/nrppg-nnet-entoend-deep-learning-approach-to-remote-hearrate-estimation-through-spatial-temporal-representation\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.teoresigroup.com\\\/de\\\/thesis\\\/nrppg-nnet-entoend-deep-learning-approach-to-remote-hearrate-estimation-through-spatial-temporal-representation\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\",\"item\":\"https:\\\/\\\/www.teoresigroup.com\\\/de\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"NrPPG-NNET: an End to End Deep Learning Approach to Remote Heart Rate Estimation Through Spatial-Temporal Representation\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.teoresigroup.com\\\/it\\\/#website\",\"url\":\"https:\\\/\\\/www.teoresigroup.com\\\/it\\\/\",\"name\":\"Teoresi Group\",\"description\":\"Engineering for Human life.\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.teoresigroup.com\\\/it\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.teoresigroup.com\\\/it\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"de\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.teoresigroup.com\\\/it\\\/#organization\",\"name\":\"Teoresi Group\",\"url\":\"https:\\\/\\\/www.teoresigroup.com\\\/it\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"de\",\"@id\":\"https:\\\/\\\/www.teoresigroup.com\\\/it\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.teoresigroup.com\\\/wp-content\\\/uploads\\\/2020\\\/12\\\/teoresi-logo-color.svg\",\"contentUrl\":\"https:\\\/\\\/www.teoresigroup.com\\\/wp-content\\\/uploads\\\/2020\\\/12\\\/teoresi-logo-color.svg\",\"width\":1,\"height\":1,\"caption\":\"Teoresi Group\"},\"image\":{\"@id\":\"https:\\\/\\\/www.teoresigroup.com\\\/it\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/pages\\\/Gruppo-Teoresi\\\/118393464917205\",\"https:\\\/\\\/www.instagram.com\\\/teoresigroup\\\/\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/teoresigroup\\\/\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UCNdBBSSax2EWPmFk5QzYP8Q\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"NrPPG-NNET: an End to End Deep Learning Approach to Remote Heart Rate Estimation Through Spatial-Temporal Representation - Teoresi Group","description":"Discover all you need to know about NrPPG-NNET: an End to End Deep Learning Approach to Remote Heart Rate Estimation Through Spatial-Temporal Representation on Teoresi Group - Teoresi Group is high profile engineering. It offers an innovative approach in close synergy with the Research and Development departments of the main industrial players.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.teoresigroup.com\/de\/thesis\/nrppg-nnet-entoend-deep-learning-approach-to-remote-hearrate-estimation-through-spatial-temporal-representation\/","og_locale":"de_DE","og_type":"article","og_title":"NrPPG-NNET: an End to End Deep Learning Approach to Remote Heart Rate Estimation Through Spatial-Temporal Representation - Teoresi Group","og_description":"Discover all you need to know about NrPPG-NNET: an End to End Deep Learning Approach to Remote Heart Rate Estimation Through Spatial-Temporal Representation on Teoresi Group - Teoresi Group is high profile engineering. It offers an innovative approach in close synergy with the Research and Development departments of the main industrial players.","og_url":"https:\/\/www.teoresigroup.com\/de\/thesis\/nrppg-nnet-entoend-deep-learning-approach-to-remote-hearrate-estimation-through-spatial-temporal-representation\/","og_site_name":"Teoresi Group","article_publisher":"https:\/\/www.facebook.com\/pages\/Gruppo-Teoresi\/118393464917205","article_modified_time":"2022-01-26T14:52:52+00:00","og_image":[{"width":1200,"height":630,"url":"https:\/\/www.teoresigroup.com\/wp-content\/uploads\/2021\/02\/og-image.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Gesch\u00e4tzte Lesezeit":"1\u00a0Minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.teoresigroup.com\/de\/thesis\/nrppg-nnet-entoend-deep-learning-approach-to-remote-hearrate-estimation-through-spatial-temporal-representation\/","url":"https:\/\/www.teoresigroup.com\/de\/thesis\/nrppg-nnet-entoend-deep-learning-approach-to-remote-hearrate-estimation-through-spatial-temporal-representation\/","name":"NrPPG-NNET: an End to End Deep Learning Approach to Remote Heart Rate Estimation Through Spatial-Temporal Representation - Teoresi Group","isPartOf":{"@id":"https:\/\/www.teoresigroup.com\/it\/#website"},"datePublished":"2021-12-23T14:31:05+00:00","dateModified":"2022-01-26T14:52:52+00:00","description":"Discover all you need to know about NrPPG-NNET: an End to End Deep Learning Approach to Remote Heart Rate Estimation Through Spatial-Temporal Representation on Teoresi Group - Teoresi Group is high profile engineering. It offers an innovative approach in close synergy with the Research and Development departments of the main industrial players.","breadcrumb":{"@id":"https:\/\/www.teoresigroup.com\/de\/thesis\/nrppg-nnet-entoend-deep-learning-approach-to-remote-hearrate-estimation-through-spatial-temporal-representation\/#breadcrumb"},"inLanguage":"de","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.teoresigroup.com\/de\/thesis\/nrppg-nnet-entoend-deep-learning-approach-to-remote-hearrate-estimation-through-spatial-temporal-representation\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.teoresigroup.com\/de\/thesis\/nrppg-nnet-entoend-deep-learning-approach-to-remote-hearrate-estimation-through-spatial-temporal-representation\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"","item":"https:\/\/www.teoresigroup.com\/de\/"},{"@type":"ListItem","position":2,"name":"NrPPG-NNET: an End to End Deep Learning Approach to Remote Heart Rate Estimation Through Spatial-Temporal Representation"}]},{"@type":"WebSite","@id":"https:\/\/www.teoresigroup.com\/it\/#website","url":"https:\/\/www.teoresigroup.com\/it\/","name":"Teoresi Group","description":"Engineering for Human life.","publisher":{"@id":"https:\/\/www.teoresigroup.com\/it\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.teoresigroup.com\/it\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"de"},{"@type":"Organization","@id":"https:\/\/www.teoresigroup.com\/it\/#organization","name":"Teoresi Group","url":"https:\/\/www.teoresigroup.com\/it\/","logo":{"@type":"ImageObject","inLanguage":"de","@id":"https:\/\/www.teoresigroup.com\/it\/#\/schema\/logo\/image\/","url":"https:\/\/www.teoresigroup.com\/wp-content\/uploads\/2020\/12\/teoresi-logo-color.svg","contentUrl":"https:\/\/www.teoresigroup.com\/wp-content\/uploads\/2020\/12\/teoresi-logo-color.svg","width":1,"height":1,"caption":"Teoresi Group"},"image":{"@id":"https:\/\/www.teoresigroup.com\/it\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/pages\/Gruppo-Teoresi\/118393464917205","https:\/\/www.instagram.com\/teoresigroup\/","https:\/\/www.linkedin.com\/company\/teoresigroup\/","https:\/\/www.youtube.com\/channel\/UCNdBBSSax2EWPmFk5QzYP8Q"]}]}},"acf":[],"_links":{"self":[{"href":"https:\/\/www.teoresigroup.com\/de\/wp-json\/wp\/v2\/thesis\/12701","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.teoresigroup.com\/de\/wp-json\/wp\/v2\/thesis"}],"about":[{"href":"https:\/\/www.teoresigroup.com\/de\/wp-json\/wp\/v2\/types\/thesis"}],"version-history":[{"count":6,"href":"https:\/\/www.teoresigroup.com\/de\/wp-json\/wp\/v2\/thesis\/12701\/revisions"}],"predecessor-version":[{"id":13448,"href":"https:\/\/www.teoresigroup.com\/de\/wp-json\/wp\/v2\/thesis\/12701\/revisions\/13448"}],"wp:attachment":[{"href":"https:\/\/www.teoresigroup.com\/de\/wp-json\/wp\/v2\/media?parent=12701"}],"wp:term":[{"taxonomy":"university","embeddable":true,"href":"https:\/\/www.teoresigroup.com\/de\/wp-json\/wp\/v2\/university?post=12701"},{"taxonomy":"thesis_type","embeddable":true,"href":"https:\/\/www.teoresigroup.com\/de\/wp-json\/wp\/v2\/thesis_type?post=12701"},{"taxonomy":"keyword","embeddable":true,"href":"https:\/\/www.teoresigroup.com\/de\/wp-json\/wp\/v2\/keyword?post=12701"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}