This researcher created an algorithm that removes the water from underwater images


I really see this as the start of the Artificial Intelligence boom in marine science. My name is Derya Akkaynak. And I am an oceanographer and engineer I specialize in problems of imaging and vision underwater. I am now in the Lembeh strait in Indonesia to test a new algorithm that I developed called Sea-thru, which takes an underwater image and removes the water from it, and it looks just like it would as if you took the photo
on land. Underwater images typically have
an overwhelming color cast, green or blue, depending on where you took them. Objects in far distances are occluded by
a layer of what we call backscatter, but think of it as a layer of haze. So, the further you are from the objects in
the scene the more haze you get in the scene. Because light as it travels through the water, gets absorbed and scattered, colors fade away. That’s where underwater images look so dull
and distorted all the time. [Music up] I’m diving with a regular consumer
camera, and I carry a color chart with me. Every time I see a reef with large 3D structure,
I place my color chart at the base of the reef, and then I swim away about 15 meters. Then I start swimming towards the reef, towards
the color chart, and photograph it from slightly different angles until I get to the reef and
then I swim over the reef, photograph the top of the reef, all sides. Once I have the distance information
all I do is I take the raw photos back to my computer, and I apply the method that uses
a certain mathematical formula, goes through each pixel and calculates what the degradation should be and removes it. Currently, in the field of underwater
imaging and marine science, we are at a standstill So if you’re a biologist, for example,
studying corals on the seafloor, and you made a survey of a reef, and you’d like to see
what species or what composition of animals are found on the seafloor, for the most part,
you have to do that manually, because the water takes away so much that you can’t see the true color of the species you’re looking for. This method is not photoshopping
an image. It’s not enhancing or pumping up the colors
in an image. It’s a physically accurate correction, rather
than a visually pleasing modification. I imagine in addition to scientists,
recreational divers or underwater photographers would also be very interested in using this
method, because finally from their images, they can remove all the degrading components
and see the vivid colors of a scene just the way they would have as if that scene was on
land. [credits]

100 Comments

  1. aditya gawhale said:

    Firstly it's not AI, it's machine learning. Secondly there are plenty of research papers on similar concepts yet very few get a YouTube video dedicated to them. Thirdly the title should say an oceanographer wrote a machine learning code to improve image clarity of underwater pictures. I wouldn't be surprised if the same people put another title as this ML evangelist created an algorithm to cure cancer (algorithm detects it in an MRI scan or X-ray pic)

    November 18, 2019
    Reply
  2. H.W. said:

    Wow, that’s incredible

    November 18, 2019
    Reply
  3. Tahoe Jones said:

    Globalwarming propaganda.
    Using the tech they're against.
    Hysterical.

    November 18, 2019
    Reply
  4. time time said:

    youtube: lets show this coz whamen. waaaaah. lol xD meanwhile mind control to control mass groups of people…

    November 18, 2019
    Reply
  5. Akmal Imdad said:

    Nobel prize

    November 18, 2019
    Reply
  6. NinjaOnANinja said:

    Eh. Idk. I feel like its being over sold.

    November 18, 2019
    Reply
  7. Harshal said:

    Come on GTA V mods did it first.

    November 18, 2019
    Reply
  8. Color Blast said:

    Is she Turkish?

    November 18, 2019
    Reply
  9. Tyilasoso said:

    Now create it for video

    November 18, 2019
    Reply
  10. Fen said:

    Pretty neat process and the resulting images are gorgeous!

    November 18, 2019
    Reply
  11. Deon Richards said:

    Just one ? if a tree falls in the woods and there is no one around does it make a sound

    November 18, 2019
    Reply
  12. A-M-R-O said:

    a bit disappointed though that she worked as a Turkish woman for an Israeli software contractor #ArabsUNITE #FreePalestine

    November 18, 2019
    Reply
  13. Shinyfluba said:

    Why couldnt you just use the color grading chart to adjust the colors. All that extra work seems unnecessary because the work seems to be just a color correction

    November 18, 2019
    Reply
  14. ThatsYKnow said:

    Isn't this just colour correction? I might be missing something since I watched the video without sound but still.

    November 18, 2019
    Reply
  15. Nobel Tv said:

    0:56 wait who the fuck drops their makeup in the ocean

    November 18, 2019
    Reply
  16. Draxvelo said:

    Ps is a thing

    November 18, 2019
    Reply
  17. WysteriaGuitar said:

    The problem is all those color cards she use are now washing up on beaches worldwide…

    November 18, 2019
    Reply
  18. Tezlashock said:

    This is wonderful. I wonder what other applications this may have!

    November 18, 2019
    Reply
  19. TheKMA said:

    Shes the moses of photography.

    November 18, 2019
    Reply
  20. FUELEDBYRICE454 said:

    Or just get a lens cap for underwater that adds in a red tint which does the same thing.

    November 18, 2019
    Reply
  21. Tom Smith said:

    This is to look in the waters of the firmament. Don't be deceived..

    November 18, 2019
    Reply
  22. beigesedan said:

    Wow! That is amazing! Well done, Ma'am!

    November 18, 2019
    Reply
  23. Serge Godin said:

    Smart lady!

    November 18, 2019
    Reply
  24. Garth said:

    Why are the people here STUPID and why are they even here. The comments are from idiots.. Well done idiots now go and watch Ariana Grande and fulfill your little minds again with crap because obviously science isn't your thing 🙂

    November 18, 2019
    Reply
  25. Luna Neptuna said:

    Same thing they use on SpongeBOB!

    November 18, 2019
    Reply
  26. John Smith said:

    Enough with the climate change bullshit you fucking libtards.

    November 18, 2019
    Reply
  27. Prof. M. Otto Zeee JCD ECS said:

    This is AMAZING!

    November 18, 2019
    Reply
  28. Tyler said:

    How did she make this algorithm from the kitchen?

    November 18, 2019
    Reply
  29. Lars Stecken said:

    Imagine how the Titanic or sunken U-Boot wrecks will look with this method. Really cool!

    November 18, 2019
    Reply
  30. redfirebelle belle said:

    👍

    November 18, 2019
    Reply
  31. Pretty Prudent said:

    Can someone please explain to me what an Algorithm is ?

    November 18, 2019
    Reply
  32. Wolfram & Hart said:

    you can already take pictures that remove the air above water

    November 18, 2019
    Reply
  33. Max Beamer said:

    We have this already in geology even in 3D using lidar and it looks better than this and zoomable to 600% but maybe ours is a patented trade secret and I’m not supposed to be talking about it 🤷‍♂️

    November 18, 2019
    Reply
  34. ArchGamer said:

    This soon will be google camera feature and they will push this update to older models too. Cough apple cough night mode

    November 18, 2019
    Reply
  35. Kawaiivee said:

    if(waterPresent)
    {waterRemove();}

    November 18, 2019
    Reply
  36. Evolventity said:

    Impressive!

    November 18, 2019
    Reply
  37. Error989 said:

    there's a physical camera filter for that… if you have a camera capable of going under water it's most likely available for it… I het it that a software fix is an interesting idea but there's already a splution that fixes it at the source

    November 18, 2019
    Reply
  38. Reagans Ghost said:

    It's not hard to adjust photos with a color chart. We've been doing this for decades on land, and I've done it with my underwater shots. This isn't new technology…

    November 18, 2019
    Reply
  39. Bill Braskey said:

    You lost me at climate change

    November 18, 2019
    Reply
  40. Damon said:

    A flash is the only other way to do it. And it seems that in shallow water this method works great! Should sell the software 🍻

    November 18, 2019
    Reply
  41. Swamp Hawk said:

    Aquaman disliked this video

    November 18, 2019
    Reply
  42. Swamp Hawk said:

    Can't wait to get this app on my phone

    November 19, 2019
    Reply
  43. 17 76 said:

    Man I'd like to send you all my diving pictures for a run through your system.

    November 19, 2019
    Reply
  44. Mocha said:

    Marine Camera Engineer: How many underwater algorithms would you like?

    Apple: Yes

    November 19, 2019
    Reply
  45. Chris A said:

    Truck load of bollocks! You want to 'put the colour' back in? Take a damn flash down with you on the camera.

    November 19, 2019
    Reply
  46. Cristal Mess said:

    Finally they can see the climate change? These "climate scientists" are blind to reality. With algorithm you can proof any thing.

    November 19, 2019
    Reply
  47. Timothy Whieldon said:

    so, all you did was take pictures with a colour chart next to it and correct the colour????? yea. nothing special here. this has been done for decades.

    November 19, 2019
    Reply
  48. Are we not entertained? said:

    i don’t get it. i’ve scuba dived for 30 years… why would i want to make the underwater realm look like the world above? nice tool to have but i would rarely use it. for a scientist… i can see benefits.

    November 19, 2019
    Reply
  49. Chevy Chase said:

    Nothing to say but thank you Derya!

    November 19, 2019
    Reply
  50. Dan Rezaie said:

    So at this point isn’t it more of an artistic interpretation?

    November 19, 2019
    Reply
  51. Allyson said:

    Wow she's amazing!👍

    November 19, 2019
    Reply
  52. WhoIsYour MasterBear said:

    She just took that from nasa, they're pros at making underwater pictures look like they're not underwater.

    November 19, 2019
    Reply
  53. Stephen Paxman said:

    GO TO THE GREAT BARRIER REEF IN AUSTRALIA INSTEAD WHERE YOU DONT NEED TO DO WHAT THIS WOMAN IS DOING

    November 19, 2019
    Reply
  54. J Patrick said:

    Pretty cool, kind of reminds me how they add colors to black and white WW2 videos

    November 19, 2019
    Reply
  55. MK2 Scirocco 2.0 16V said:

    This is how NASA films their "space walks" 🤔

    November 19, 2019
    Reply
  56. AnnaKahlo said:

    That's awesome!

    November 19, 2019
    Reply
  57. What tf is going on said:

    Good for her! It is so wonderful to get to see the colors that we could have never imagined in our oceans! I was stunned by the images. Who ever thumbed down this video should be ashamed of themselves!

    November 19, 2019
    Reply
  58. Ty said:

    If you remove the water it’s not even an underwater picture anymore smh

    November 19, 2019
    Reply
  59. freespeechisdead isdead said:

    Brilliant. One hint (as I'm sure she's going to see my piddly comment). I'd say, "You'll see your photos as if the light wasn't scattered." Or, "You'll see your photos without the green/blue degradation." Or, "You'll see the true colors of your photo."

    That one line, "You'll see your photos as if they were taken on land." confuses me. Because my brain goes, "But I took this under water. I don't want to see what it would look like on land."

    November 19, 2019
    Reply
  60. Stranger in Town said:

    The ultimate algae-rithm

    November 19, 2019
    Reply
  61. Binge Planet said:

    The only problem is moving organisms won't stay still for a dozen reimaging pictures. Still good stuff

    November 19, 2019
    Reply
  62. Jesse Garcia said:

    I wonder if the fish see the same way as that camera captures the true condent of the pictures..🤔🤔🤔🤔

    November 19, 2019
    Reply
  63. Victor Da Silva said:

    Cool.

    November 19, 2019
    Reply
  64. help me get better said:

    Take the color chart, put it next to the thing, take a bunch of photos, open the photos in photoshop, true up the colors on the color chart to their actual color code. The water is gone from the thing.

    November 19, 2019
    Reply
  65. OregonOutdoorsChris said:

    It's still taking significant artistic liberties, ie. photoshop. The reality is that the color information is lost completely as the wavelengths get filtered out; black and red become the same thing and no amount of color charts can fix that.

    November 19, 2019
    Reply
  66. Jason C. Rochon said:

    Bravo! 👏

    November 19, 2019
    Reply
  67. Ghardyne said:

    I can finally play Battlefield without the colorfilter!

    November 19, 2019
    Reply
  68. PunaJussi said:

    Reference target card is rather trivial concept. Is this simply about creating a profile for the raw images using a color reference card and an "algorithm"? I mean digital photography is basically all about using a bunch of "algorithms". Scientific American makes a poor job explaining this or their angle is weird emphasizing the use of reference target. Sure, pictures look great, but this seems like fundamental digital photography using fundamental digital photography techniques.

    November 19, 2019
    Reply
  69. Saturn Reign said:

    I love smart innovative women, so beautiful, so inspiring!

    November 19, 2019
    Reply
  70. Nilavra Pathak said:

    I took a glance at her CVPR paper it is quite remarkable. Look up Sea-thru

    November 19, 2019
    Reply
  71. Brad the Pitts said:

    It would be cool to create special glasses that show what women in the singles bars look like without their makeup.

    November 19, 2019
    Reply
  72. DreidMusicalX said:

    So its not being corrected in the camera at the time of filming it? If not, its seems like the next logical step.

    November 19, 2019
    Reply
  73. Scarlett Nugent said:

    See, water isn’t wet.

    November 19, 2019
    Reply
  74. Anthony M said:

    Very cool

    November 19, 2019
    Reply
  75. IamGulzow said:

    Awesome!

    November 19, 2019
    Reply
  76. Gnawty’s Ayy De La Lmao said:

    AI and Algorithms are not the same!!!!!!

    November 19, 2019
    Reply
  77. Deb Talukdar said:

    It's just like a filter.

    November 19, 2019
    Reply
  78. Costeno Salao said:

    Is there an algorithm i can use to remove her wetsuit?

    November 19, 2019
    Reply
  79. TMB247 said:

    Thank you Derya!

    November 19, 2019
    Reply
  80. Ozarudin Azman said:

    I would like to Sea-Thru her ( ͡° ͜ʖ ͡°)

    November 19, 2019
    Reply
  81. Laszlo Baranyai said:

    Color correction isn't a new thing and neither is this. Just an added feature to something that existed long ago. AI more than likely was used to do it. Dreamworks studio already has proprietary software and supercomputers that do this. Color correction isn't very difficult once you understand how color, filters, saturation, hue and contrast work with the color wheel.

    November 19, 2019
    Reply
  82. Aubrey GDJ said:

    Another example of human ingenuity.

    November 19, 2019
    Reply
  83. randal gibbons said:

    Wow!!

    November 19, 2019
    Reply
  84. Maximus Prometheus said:

    Soooo….She just used Photoshop AKA her algorithm.

    November 19, 2019
    Reply
  85. Nunya Business said:

    Give this woman a medal

    November 19, 2019
    Reply
  86. Noealz - Rain Photography said:

    thats cool

    November 19, 2019
    Reply
  87. Bongo Baggins said:

    She's got a nice arse in a wet suit for an old bird

    November 19, 2019
    Reply
  88. Generic Egg said:

    I was kinda thinking that if she just took a pic of the deep, when the algorithm is applied, fish and sharks would be floating mid-air and we can finally see the bottom of the ocean.

    November 19, 2019
    Reply
  89. Happy Fallen said:

    Very exciting and kudos to her!

    November 19, 2019
    Reply
  90. mikes5637 said:

    I have a device for photographing fish with the water removed. It's called a fishing rod.

    November 19, 2019
    Reply
  91. Wanaaje's Channel said:

    Great work.

    November 19, 2019
    Reply
  92. Stephen Summers said:

    my guess is that it uses those color squares to know what the colors should be on land. Then as the water degrades the color on the squares from the distance, it knows what color to correct them too, to make them the colors that would be on land. Then it adjusts the rest of the pixels in the image based on the square colors. In other words, it knows what the underwater colors should be based on what it knows the squares look like when they are not underwater. It's probably not too terribly complicated.

    November 19, 2019
    Reply
  93. euanme3 said:

    Really interesting until they bought up the old "climate change" BS

    November 19, 2019
    Reply
  94. tokyootower said:

    I bet everyone with a joke has no clue what you have really achieved and wouldn't have a clue how to start. I appreciate your hard work and what you have accomplished.

    November 19, 2019
    Reply
  95. Richard S said:

    The results look no different than using a white slate and manual white balance, effectively neutralising the effect of the red end of the light spectrum being filtered out progressively at depth.
    I guess it's nice to have an "automatic" way of applying manual white balance during editing on dry land rather than having to use a colour slate and manually adjust for shots underwater (you dont have to use that colour slate every time right ? That was just to develop the algo?) But I dont see the "revolution" in this – it doesnt seem to eliminate back scatter or increase detail at range (even in RAW the back scatter is reflected light, so I'm not sure how an algo could put back in that detail that the image has lost?).
    It's cool and I dont mean to be negative , but it strikes me more as a "useful alternative to manual white balance per image, to use as a blanket lightroom preset" than it does as a "revolutionary new way to remove water from underwater images".

    November 19, 2019
    Reply
  96. royalfinest said:

    GoPro wants to know your location

    November 19, 2019
    Reply
  97. Matt The King said:

    Just wait till the Google Pixel gets this Technology….🤯

    November 19, 2019
    Reply
  98. Миодраг Здравковић said:

    2:01 That's the picture that I really like and for me you do not need to remove the water at all because I can clearly see what I need and everything you have to do for me honey bunny is to get out of water yourself and that's enough for me, I mean we can have fun underwater but that's for amateurs, pros do it in water bed! 🙂

    November 19, 2019
    Reply
  99. Johnny Vance said:

    What a Boss!!!!

    November 19, 2019
    Reply
  100. Michael Brown said:

    How can consumers purchase this filter/algorithm? I assume for photoshop or other?

    November 19, 2019
    Reply

Leave a Reply

Your email address will not be published. Required fields are marked *