The quest for computer vision requires lots of data — including real-world images. But that can be hard to find, which has led researchers to look in some pretty creative places.
The above video shows how researchers used TikTok dances and the Mannequin Challenge to train AI. The quest is for “ground truth” — real-world examples that can be used to train or grade an AI on its guesses. TikTok datasets provide this by showing lots of movement, clothing types, backgrounds, and people. That diversity is key to train a model that can handle the randomness of the real world.
The same thing happens with the Mannequin Challenge. All those people pretending to stand still gave researchers — and their models — more real-world data to train with than they ever could have hoped for.
You can find this video and the entire library of Vox’s videos on our YouTube Channel.
ph**********@*ox.com“}],”byline_enabled”:true,”byline_credit_text”:”By”,”byline_serial_comma_enabled”:true,”comment_count”:0,”comments_enabled”:false,”legacy_comments_enabled”:false,”coral_comments_enabled”:false,”coral_comment_counts_enabled”:false,”commerce_disclosure”:null,”community_name”:”Vox”,”community_url”:”https://www.vox.com/”,”community_logo”:”rn“,”cross_community”:false,”groups”:[{“base_type”:”EntryGroup”,”id”:24021,”timestamp”:1682454574,”title”:”Video”,”type”:”SiteGroup”,”url”:”https://www.vox.com/videos”,”slug”:”videos”,”community_logo”:”rn“,”community_name”:”Vox”,”community_url”:”https://www.vox.com/”,”cross_community”:false,”entry_count”:1247,”always_show”:false,”description”:”Videos that explain the news, and the world around you. Watch more videos on Vox’s YouTube channel and subscribe for updates. “,”disclosure”:””,”cover_image_url”:””,”cover_image”:null,”title_image_url”:””,”intro_image”:null,”four_up_see_more_text”:”View All”,”primary”:true},{“base_type”:”EntryGroup”,”id”:27524,”timestamp”:1682596804,”title”:”Technology”,”type”:”SiteGroup”,”url”:”https://www.vox.com/technology”,”slug”:”technology”,”community_logo”:”rn“,”community_name”:”Vox”,”community_url”:”https://www.vox.com/”,”cross_community”:false,”entry_count”:24372,”always_show”:false,”description”:”Uncovering and explaining how our digital world is changing — and changing us.”,”disclosure”:””,”cover_image_url”:””,”cover_image”:null,”title_image_url”:””,”intro_image”:null,”four_up_see_more_text”:”View All”,”primary”:false},{“base_type”:”EntryGroup”,”id”:80311,”timestamp”:1682596804,”title”:”Artificial Intelligence”,”type”:”SiteGroup”,”url”:”https://www.vox.com/artificial-intelligence”,”slug”:”artificial-intelligence”,”community_logo”:”rn“,”community_name”:”Vox”,”community_url”:”https://www.vox.com/”,”cross_community”:false,”entry_count”:356,”always_show”:false,”description”:”Vox’s coverage of how AI is shaping everything from text and image generation to how we live. “,”disclosure”:””,”cover_image_url”:””,”cover_image”:null,”title_image_url”:””,”intro_image”:null,”four_up_see_more_text”:”View All”,”primary”:false},{“base_type”:”EntryGroup”,”id”:102794,”timestamp”:1682596804,”title”:”Innovation”,”type”:”SiteGroup”,”url”:”https://www.vox.com/innovation”,”slug”:”innovation”,”community_logo”:”rn“,”community_name”:”Vox”,”community_url”:”https://www.vox.com/”,”cross_community”:false,”entry_count”:155,”always_show”:false,”description”:””,”disclosure”:””,”cover_image_url”:””,”cover_image”:null,”title_image_url”:””,”intro_image”:null,”four_up_see_more_text”:”View All”,”primary”:false}],”internal_groups”:[],”image”:{“ratio”:”*”,”original_url”:”https://cdn.vox-cdn.com/uploads/chorus_image/image/72216320/VDC_AIX_005_Depth_Estimation_THUMB_CLEAN.0.jpg”,”network”:”unison”,”bgcolor”:”white”,”pinterest_enabled”:false,”caption”:null,”credit”:null,”focal_area”:{“top_left_x”:807,”top_left_y”:387,”bottom_right_x”:1113,”bottom_right_y”:693},”bounds”:[0,0,1920,1080],”uploaded_size”:{“width”:1920,”height”:1080},”focal_point”:null,”image_id”:72216320,”alt_text”:””},”hub_image”:{“ratio”:”*”,”original_url”:”https://cdn.vox-cdn.com/uploads/chorus_image/image/72216320/VDC_AIX_005_Depth_Estimation_THUMB_CLEAN.0.jpg”,”network”:”unison”,”bgcolor”:”white”,”pinterest_enabled”:false,”caption”:null,”credit”:null,”focal_area”:{“top_left_x”:807,”top_left_y”:387,”bottom_right_x”:1113,”bottom_right_y”:693},”bounds”:[0,0,1920,1080],”uploaded_size”:{“width”:1920,”height”:1080},”focal_point”:null,”image_id”:72216320,”alt_text”:””},”lede_image”:{“ratio”:”*”,”original_url”:”https://cdn.vox-cdn.com/uploads/chorus_image/image/72216320/VDC_AIX_005_Depth_Estimation_THUMB_CLEAN.0.jpg”,”network”:”unison”,”bgcolor”:”white”,”pinterest_enabled”:false,”caption”:null,”credit”:null,”focal_area”:{“top_left_x”:807,”top_left_y”:387,”bottom_right_x”:1113,”bottom_right_y”:693},”bounds”:[0,0,1920,1080],”uploaded_size”:{“width”:1920,”height”:1080},”focal_point”:null,”image_id”:72216320,”alt_text”:””},”group_cover_image”:null,”picture_standard_lead_image”:{“ratio”:”*”,”original_url”:”https://cdn.vox-cdn.com/uploads/chorus_image/image/72216320/VDC_AIX_005_Depth_Estimation_THUMB_CLEAN.0.jpg”,”network”:”unison”,”bgcolor”:”white”,”pinterest_enabled”:false,”caption”:null,”credit”:null,”focal_area”:{“top_left_x”:807,”top_left_y”:387,”bottom_right_x”:1113,”bottom_right_y”:693},”bounds”:[0,0,1920,1080],”uploaded_size”:{“width”:1920,”height”:1080},”focal_point”:null,”image_id”:72216320,”alt_text”:””,”picture_element”:{“html”:{},”alt”:””,”default”:{“srcset”:”https://cdn.vox-cdn.com/thumbor/I7lrYF2jAMwSnS75ERZTezvfEq4=/0x0:1920×1080/320×240/filters:focal(807×387:1113×693)/cdn.vox-cdn.com/uploads/chorus_image/image/72216320/VDC_AIX_005_Depth_Estimation_THUMB_CLEAN.0.jpg 320w, https://cdn.vox-cdn.com/thumbor/JaQKMmQVfCnW9_vDflfeI0sCyBk=/0x0:1920×1080/620×465/filters:focal(807×387:1113×693)/cdn.vox-cdn.com/uploads/chorus_image/image/72216320/VDC_AIX_005_Depth_Estimation_THUMB_CLEAN.0.jpg 620w, https://cdn.vox-cdn.com/thumbor/DlNHmwOGjfgI_6QOKeETEwWyBI4=/0x0:1920×1080/920×690/filters:focal(807×387:1113×693)/cdn.vox-cdn.com/uploads/chorus_image/image/72216320/VDC_AIX_005_Depth_Estimation_THUMB_CLEAN.0.jpg 920w, https://cdn.vox-cdn.com/thumbor/Sst6ziCU4WdTNqMyOdDlo6l89gg=/0x0:1920×1080/1220×915/filters:focal(807×387:1113×693)/cdn.vox-cdn.com/uploads/chorus_image/image/72216320/VDC_AIX_005_Depth_Estimation_THUMB_CLEAN.0.jpg 1220w, https://cdn.vox-cdn.com/thumbor/nVyFqauuO5bKyZuIavsCTca82Qw=/0x0:1920×1080/1520×1140/filters:focal(807×387:1113×693)/cdn.vox-cdn.com/uploads/chorus_image/image/72216320/VDC_AIX_005_Depth_Estimation_THUMB_CLEAN.0.jpg 1520w”,”webp_srcset”:”https://cdn.vox-cdn.com/thumbor/TP5NzDgo1mnJA1IeuoOJdSObrC8=/0x0:1920×1080/320×240/filters:focal(807×387:1113×693):format(webp)/cdn.vox-cdn.com/uploads/chorus_image/image/72216320/VDC_AIX_005_Depth_Estimation_THUMB_CLEAN.0.jpg 320w, https://cdn.vox-cdn.com/thumbor/jx_Er0wGXIhMBUge_u2fkOfOS9g=/0x0:1920×1080/620×465/filters:focal(807×387:1113×693):format(webp)/cdn.vox-cdn.com/uploads/chorus_image/image/72216320/VDC_AIX_005_Depth_Estimation_THUMB_CLEAN.0.jpg 620w, https://cdn.vox-cdn.com/thumbor/JWdf66h6VHtEEbVLIccZAKAB2-c=/0x0:1920×1080/920×690/filters:focal(807×387:1113×693):format(webp)/cdn.vox-cdn.com/uploads/chorus_image/image/72216320/VDC_AIX_005_Depth_Estimation_THUMB_CLEAN.0.jpg 920w, https://cdn.vox-cdn.com/thumbor/L2K6MWNy-uIL34dLpp5AJ7WDyuo=/0x0:1920×1080/1220×915/filters:focal(807×387:1113×693):format(webp)/cdn.vox-cdn.com/uploads/chorus_image/image/72216320/VDC_AIX_005_Depth_Estimation_THUMB_CLEAN.0.jpg 1220w, https://cdn.vox-cdn.com/thumbor/XnKIcM58myzwxHtGx4lOc-6lR6U=/0x0:1920×1080/1520×1140/filters:focal(807×387:1113×693):format(webp)/cdn.vox-cdn.com/uploads/chorus_image/image/72216320/VDC_AIX_005_Depth_Estimation_THUMB_CLEAN.0.jpg 1520w”,”media”:null,”sizes”:”(min-width: 809px) 485px, (min-width: 600px) 60vw, 100vw”,”fallback”:”https://cdn.vox-cdn.com/thumbor/K0sXHD_P2Zl9QA61pCsp-SaXN1I=/0x0:1920×1080/1200×900/filters:focal(807×387:1113×693)/cdn.vox-cdn.com/uploads/chorus_image/image/72216320/VDC_AIX_005_Depth_Estimation_THUMB_CLEAN.0.jpg”},”art_directed”:[]}},”image_is_placeholder”:false,”image_is_hidden”:false,”network”:”vox”,”omits_labels”:true,”optimizable”:false,”promo_headline”:”How TikTok dances trained an AI to see”,”recommended_count”:0,”recs_enabled”:false,”slug”:”videos/2023/4/25/23698059/tiktok-ai-depth-estimation-mannequin-challenge”,”dek”:”And remember the Mannequin Challenge? Yep, they used that too.”,”homepage_title”:”How TikTok dances trained an AI to see”,”homepage_description”:”And remember the Mannequin Challenge? Yep, they used that too.”,”show_homepage_description”:false,”title_display”:”How TikTok dances trained an AI to see”,”pull_quote”:null,”voxcreative”:false,”show_entry_time”:true,”show_dates”:true,”paywalled_content”:false,”paywalled_content_box_logo_url”:””,”paywalled_content_page_logo_url”:””,”paywalled_content_main_url”:””,”article_footer_body”:”Since Vox launched in 2014, our audience has supported our mission in so many meaningful ways. More than 80,000 people have responded to requests to help with our reporting. Countless teachers have told us about how they’re using our work in their classroom. And in the three years since we launched the Vox Contributions program, tens of thousands of people have chipped in to help keep our unique work free. We’re aiming to add 1,500 financial contributions from readers by the end of April, and we only need 124 more contributions to get there. Will you help us close the gap?“,”article_footer_header”:”We’re nearly there!“,”use_article_footer”:true,”article_footer_cta_annual_plans”:”{rn “default_plan”: 1,rn “plans”: [rn {rn “amount”: 95,rn “plan_id”: 74295rn },rn {rn “amount”: 120,rn “plan_id”: 81108rn },rn {rn “amount”: 250,rn “plan_id”: 77096rn },rn {rn “amount”: 350,rn “plan_id”: 92038rn }rn ]rn}”,”article_footer_cta_button_annual_copy”:”year”,”article_footer_cta_button_copy”:”Yes, I’ll give”,”article_footer_cta_button_monthly_copy”:”month”,”article_footer_cta_default_frequency”:”annual”,”article_footer_cta_monthly_plans”:”{rn “default_plan”: 1,rn “plans”: [rn {rn “amount”: 9,rn “plan_id”: 77780rn },rn {rn “amount”: 20,rn “plan_id”: 69279rn },rn {rn “amount”: 50,rn “plan_id”: 46947rn },rn {rn “amount”: 100,rn “plan_id”: 46782rn }rn ]rn}”,”article_footer_cta_once_plans”:”{rn “default_plan”: 0,rn “plans”: [rn {rn “amount”: 20,rn “plan_id”: 69278rn },rn {rn “amount”: 50,rn “plan_id”: 48880rn },rn {rn “amount”: 100,rn “plan_id”: 46607rn },rn {rn “amount”: 250,rn “plan_id”: 46946rn }rn ]rn}”,”use_article_footer_cta_read_counter”:true,”use_article_footer_cta”:true,”featured_placeable”:false,”video_placeable”:true,”disclaimer”:null,”volume_uuid”:”b08a9f160″,”volume_placement”:”lede”,”analytics_placement”:”article:lede”,”video_autoplay”:false,”youtube_url”:”http://bit.ly/voxyoutube”,”facebook_video_url”:””,”play_in_modal”:true,”user_preferences_for_privacy_enabled”:false,”start_time”:null,”player_choice”:null,”video_mask_text”:null,”video_embed_code”:”
n”,”caption”:null,”show_branded_logos”:true}”>
$95/year
$120/year
$250/year
$350/year
Other
Yes, I’ll give $120/year
Yes, I’ll give $120/year
We accept credit card, Apple Pay, and
Google Pay. You can also contribute via
Read More
Tomi Grisby