Thoughts on computational photography bending the definition of a "photo"
Sponsored by Cash App: Download from App Store/Google Play store - Use code MARQUES for $15 and $10 goes to Girls Who Code!
MKBHD Merch: http://shop.MKBHD.com
Tech I'm using right now: https://www.amazon.com/shop/MKBHD
Playlist of MKBHD Intro music: https://goo.gl/B3AWV5

http://twitter.com/MKBHD
http://instagram.com/MKBHD
http://facebook.com/MKBHD

So there are three cameras on the back of the iphone 13 pro, the main camera, the ultra wide and the telephoto. So this one down here at the bottom, this is the main camera. So if you cover it with your finger, you can see the frame goes. Dark makes sense if you cover the other two.

Nothing happens now when you hit that 3x button to zoom into 3x, it's supposed to switch to that telephoto camera right, but sometimes when you zoom into 3x and then cover the main camera, it still goes dark. Why? This is because the iphone's camera thinks it knows better than you, and it usually does basically in certain conditions, especially with lower light, you could get a worse photo out of actually switching to the telephoto camera, which is a smaller sensor with a smaller aperture that lets In less light, and can be more noisy so sometimes when you hit that 3x, it just crops in on the main, big camera and doesn't even tell you and that's actually going to give you a better photo see. Smartphone cameras are smart, but something i've been thinking. A lot about lately is they've gone past, smart they're bending reality, so i'm in the middle of running the blind, smartphone camera test over on instagram right now.

If you haven't already gotten in and start voting on those, you should do it. It's a fascinating experiment. Every time, but a thought i've had is maybe it's not just the brightest photo, that's going to win every single time, so i actually think that similar to how, in this tech bubble, we underestimate how many people put cases on their phones. At least i do there's also a bit of an underestimation of how many people want to just be able to take a photo and post it with zero edits.

Now that's kind of crazy in the tech world or in the photography world. We want the more neutral photo, the one with more information and that's the better photo to us, because then we can go, take it and edit it and make it exactly how we want, because we want that control, but to most people if they can just take Their phone and point and shoot, and the photo that comes out of that is perfectly good enough to post, with no edits at all that to them is a great camera and now you're letting, of course, the camera do all of the editing for you, which means You have the least amount of control over the final look. Now the danger of giving up all the control is, our photos become a product of someone else's vision technically, and this is where it starts to get crazy, because every smartphone company sees things a little differently right. We already know a pixel photo looks different from an iphone photo which looks different from huawei phones, which look different from xiaomi shots.

Every picture is the result of an image processing pipeline that is tuned by people, and that is a reflection of their biases and their skills and what they think we want, which means every photo we take. Even if it's of the same thing will be slightly different. Just depending on what camera you take it with which one is real, which one is the most accurate, maybe it doesn't matter in 2019 the huawei p30 pro came out. It had a pretty solid set of cameras, it was a flagship phone of course, so people went out and tested its limits and pretty quickly something sort of fishy came up.
So when you went outside at night and pointed the new periscope zoom camera at the moon and zoomed, all the way in the camera would recognize the moon and suggest you turn moon mode on, and people started doing this and posting their results and everyone's pictures of The moon looked surprisingly similar. Now, maybe i should be shocked. I mean we're all taking pictures of the same moon, but have you ever tried to take a picture of the moon with your camera on your phone? It's usually just a blob. It never looks that good and these all looked really good, maybe a little too good.

And that's what android authority concluded with enough samples. They believe that huawei is using ai to not just recognize that you're taking a picture of the moon, but also to then superimpose a stored image of the moon and merge it onto your photo. Now. First glance: that's pretty crazy, but that's also kind of clever, because the moon is tidally locked with the earth, meaning one rotation takes the same amount of time as one orbit, so one face of the moon is always pointing towards earth.

So you only see one side of the moon all the time, meaning it's always going to look the same, and you only need one stored image of the moon to superimpose over everyone's photos. So maybe that's not so bad, but huawei denied this, of course, but the seed was definitely planted and my take honestly at the time was like all right. Well, you have this ai mode in your camera anyway, and it's already recognizing scenes and adjusting things and changing things to enhance your photos already. Why not add a picture of the moon in there, but it does bring up the question a totally fair question, which is how far is too far like people already seem to want the most finished version of their photos straight out of camera and so you're doing Edits and enhancements how far is too far xiaomi phones, we already know, can detect a landscape and make the blue sky bluer or they'll crank up the green on the green grass, but also some of these phones from chinese vendors have very different, acceptable levels of body And face adjustment, so this xiaomi mi 11 ultra when you open the selfie camera, has a beauty filter, but this isn't just facial smoothing.

It literally lets you move your hairline changes, the shape of your chin and your nose. It can slender up your face. It changes the size of your lips and your cheeks. It can make your eyes bigger or smaller, and you can put makeup on yourself and it's all just built into the camera out the box and is totally normal and accepted kind of reminds me of uh.
When there was a sort of a commercialized version of this, when the galaxy s9 in the united states had a bixby vision, feature to try on makeup, and then you could swap between different shades of lipstick and blush and eye shadow, and then bixby would give you A link to buy the actual retail version of that makeup, but really the most powerful adjustments are the ones that happen. When you don't even know it and you didn't even ask for it, they happen in the background. It's the highest level of computational photography, so google's pixel 6 is always running the main camera at one shutter speed and the ultrawide camera at a much faster shutter speed at the same time. So if you take a photo of a moving person, the phone detects the face realizes if it's blurry it can take a non-blurry copy from the ultrawide camera and merge it onto your subject to keep just the face.

Crisp and clear. All of this happens in the background, without you even asking, there's also already a feature in facetime on iphones called eye contact that moves your pupils to make it look like you're, making eye contact with the camera, even though you're not you're. Looking at the screen below the camera, but it's pretty eerie and slightly creepy and it works a little too well, but at least you can turn it off and i could swear this was a feature somewhere. I must have been imagining a keynote, but i can't find it anywhere, so i'm going to predict that this future will exist at some point in some phone, probably in something like a pixel.

First imagine you're taking a group selfie shot. There's a bunch of people with you, you hit the shutter button and almost everyone has their face, not blinking and smiling, but at different moments. Everyone has sort of their ideal face, so the software smartly goes through and merges the best smiling non-blinking face for everyone. In the selfie doesn't even tell you just does it in the background we've actually seen versions of this working our way up to this feature so believe it or not.

In 2012, a nokia lumia phone had a selfie mode where you'd hold for five seconds and then, after the shot, you could scroll between five different faces of selfies to pick which one you like the best. So it sounds crazy, but that's the thought i've been. Having is this is the direction smartphone cameras are going, which is as computational photography gets better and better and we're merging more and more things in eventually, these cameras are outputting captures of moments in time that never really happened. So it's easy to see a future where smartphone cameras just recognize all kinds of things like ai mode.

Right now is pretty basic, it'll, see a sunset and make the oranges brighter, but maybe it'll start recognizing all types of objects: you're, uh, you're in front of a popular instagram wall in santa monica somewhere, and it notices you take a picture in front of it. It's like, oh, i have a downloaded picture of that in our database and it just wipes out all the people in the background and makes you perfectly flat on that image without you even asking that could happen in the future. At that point, basically, the whole world turns into ai recognizable qr codes, where your ai camera is just being triggered by all sorts of objects and things around you to morph into recognized situations. It is kind of crazy to think about, but while we're in this new reflective mode shout out to new channel sponsor cash, app cash app i'd say is just the right level of futuristic.
So it's already a great app for sending and requesting money from your friends or you get dinner with somebody and just want to reimburse them that's easy, but you can also buy stocks or buy bitcoin with it. So if you haven't already signed up feel free to use the link below or my code marquez and 15 bucks will just appear in your account. You're, welcome also 10 will go to girls who code but yeah my take is. I don't have a solution for this eerily dystopian smartphone camera future.

But i wonder, are you? Okay, with smartphone cameras, spitting out, finished images that are further and further from reality, they're? Basically, bending the definition of a photo, let me know what you think either way. That's been it thanks for watching catch, you guys, the next one peace.

By MKBHD

17 thoughts on “Smartphone cameras vs reality!”
  1. Avataaar/Circle Created with python_avatars Lou B says:

    It's a Deep Fake LIFE, Man!
    I hope The Tech doesn't forget to send me an email that I've already died! (I'd hate to miss that!)
    Most Folks will probably vote in favor of more of this. Not being willing to put in the work, it's the only way their gonna steal the chops of a good Photographer.
    'S Okay, I guess. Wouldn't want to wake People up from their dream state Reality, enjoying their whitewashed moral high ground, and coveting their neighbor's mass-produced, disposable luxuries!
    I.G.Y., anyone?

  2. Avataaar/Circle Created with python_avatars Noah Garcia says:

    I think it is scary how far we will bend technology. Social media has taken the form of an almost real life, face-to-face communication, so it is scary to see such high level of beautification. I get the idea that it is cool and all and could overcome some stigmatization, but we should love how we are too. There could be an argument that our profiles reflect who we want to be, but should we look at people based on what they could and want to be, and is it even possible to change our hairlines, noses, jaws, etc. in real life? I feel like we are going down a dangerous path where everyone will be catfishing without even knowing. I just wish the (stigmatizing) idea that looks don’t matter too much was promoted first, and people could have full control of the level of beautification and or reality bending second.

  3. Avataaar/Circle Created with python_avatars Bayonet says:

    Photographs, whether they be out of a smartphone, MILC, DSLR, or a film camera, have never been a completely accurate rendition of a scene. Lenses do not operate like the human eye; with set focal planes, different perspectives and projections. Shutter speeds represent motion in unrealistic ways; either being blurred or frozen in time). Colours and tones are just an interpretation by the manufacturer of digital camera or film. And this is all before we get to choices made by the photographer.

  4. Avataaar/Circle Created with python_avatars Gray Johnson says:

    If only you know what the future says, you'll know that indeed cryptocurrency is the future, investing in it now will be the wisest thing to do. Hold!!! And you"'ll thank yourself

  5. Avataaar/Circle Created with python_avatars Juan C says:

    The commercial of the cash app was a brutal landing to reality!
    Wondering if Marques has given a thought to the tons of people that are losing money "investing" (or should I say betting) in random crypto… I know, we're all grownups but… 🤷🏻‍♂️
    Great video anyway!

  6. Avataaar/Circle Created with python_avatars Craig says:

    I really value real pictures, and wanted the closest thing to reality, just photons hitting an image sensor, so I bought a Sony phone, after all they’re not strong at all on AI but really focus on the camera quality of their phones, unfortunately it was utter shite so I bought an iPhone.

  7. Avataaar/Circle Created with python_avatars Siri Pod says:

    To be honest, I still miss the iPhone 6 camera of its non-computational camera. Since it gave the most real world physical state of lights, colour, skin tone, and even the detail of the photo is sharper than current iPhones' blurry images. The computational photography nowadays doesn't give accurate colour and lights, you would find it heavily adjusted, especially in the situation when the subject looks dark in the sunlight. I think the meaning of computational photography is to breakthrough the physical limitation of lens, so users wouldn't have to adjust the result. But if you're a more serious Instagramer, you see they'd still have to adjust the picture. So, computational photography is still a little early, when smartphone lenses can still breakthrough. Also, I'd say Google has the best computational photography as it's keeping the sharpness and colour. The iPhone is very good on videos, especially at night, but the photos are not on par and overly adjusted.

  8. Avataaar/Circle Created with python_avatars Alexander Denchev says:

    I feel like if this really becomes an issue, people will notice, the tech or photography communities will uproar and developers will eventually give us a "raw" or at least "rawer" mode that ditches AI features for the sake of really capturing the moment.

  9. Avataaar/Circle Created with python_avatars Ernest Jay says:

    This is the reason why i'm using "Pro Mode" as a default mode on my camera especially on Samsung phones and Sony Xperia phones, not because i'm a professional photographer, but Pro Mode even on basic setting makes camera take the picture as real as it gets without any Ai enchantment , beauty filter, etc.

  10. Avataaar/Circle Created with python_avatars AFJ says:

    have you actually used the app from your new sponsor, I mean come now I need to hear you at least fill out the segment with some words of endorsement and experience with the app that would reassure me, unlike the reviews I subsequently found after watching this video I expect better from you sir!!!

  11. Avataaar/Circle Created with python_avatars Mohamed Mabrouk says:

    I don't mind bending reality in pictures. It's natrual. Like a painting carries the mood of the painter than the character of the painted. Like the memories of an event is far removed from reality and really dependent on our mood then. Photos were too unnatural promising to be "real". But photographers learnt to trick us so quickly with things like "untouched" or "unedited" but it was all playing with lenses purity, curvature, and polarity, added to shutter speed and light amount to inspire speed of an athelete or show objects by night in lights of the stars. We were tricked by those beautiful minds from day 1. Now, we're just realizing the truth.. beauty will always be the product of the mind of the photo manipulator.

  12. Avataaar/Circle Created with python_avatars Da Phenomenalz says:

    Marques, i think you should make a video on Apple's huge secret deal with China and how they will be using more of china manufacturing and even parts for their new products. And they will be teaching china on how to build software and hardware like apple's. This is serious. And after this news, i will never any apple product. Never.

    So, i think you should make a vidoe on it.

  13. Avataaar/Circle Created with python_avatars Damian Heinz Sakoor says:

    Camera phones are configured with the same biases and skills (experiences) that we have. We all see slightly different to vastly different things when we look at the same object through our eyes.

    We don't all have 20/20 vision and we all look for and focus different things when we look at an object.

    Same goes for editing. We will all edit a photo in a different way to the point where each person ends with a different photo.

  14. Avataaar/Circle Created with python_avatars AFTHD. says:

    Whenever I watch every tech video it reminds me of how broke I am 😭.
    And then you guys even say a 1000 dollar phone isn't good enough I can't even get one for a 100 dollars.

  15. Avataaar/Circle Created with python_avatars johnnybyup says:

    That beauty mode in the Xiaomi phone is ruining people's natural perception of themselves. That's no cool. I know girls that refused to post a picture of there "normal" face, since the filter is the only way they want to be scene. It's making multiple generations self-esteem and self-confidence the lowest they've ever been.
    Just my take on it.

  16. Avataaar/Circle Created with python_avatars Psychos1s says:

    I want my photos to be reminders of the past. Essentially a photo that looks how it looked when i viewed the scene with my own eyes. I don't want a glamour unrealistic shot. They should have normal mode "real" and social media mode "glamour / not true" shot.

  17. Avataaar/Circle Created with python_avatars user975bg says:

    Yes, yes, yes I am exactly the type that wants bright, beautiful, processed photos straight out of the phone camera. I don’t care for realistic skin tones and colors. I want my photo world to look more beautiful than reality. I don’t want and don’t have time to edit anything.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.