• Home
  • AI

GPT 4 Got Upgraded – Code Interpreter (ft. Image Editing, MP4s, 3D Plots, Data Analytics and more!)

GPT 4 Code Interpreter is unlike any other plug-in. It upgrades GPT 4 to a whole new level. I am going to show you 18 use-cases (actually more like 23), including image editing (wait till the end!), text-to-speech, video editing, 3d modelling, data analytics, QR Codes, times series, sankey diagrams, steganography, mp4s, GIFs, treemaps, better math, editing csv and excel files and much much more!

Whether you are a professional looking to transform your data analytics, an observer concerned about GPT X escaping from an island (!), a student looking to do a heatmap, venn diagram or radial bar plot, this video is for you. Featuring a dozen visualisations using the Code Interpreter GPT 4 plugin that have not been seen before (to the best of my knowledge), I will show you it all, and give you killer tips along the way.

Non-Hype, Free Newsletter:

Joe Lilli
 

  • @Antares0210 says:

    10:57 that sounds exactly like a System Prompt that the session could be working with. Maybe it considered the System prompt the beginning instead of your first message. It would be really cool if that was the case, since it would give some insight into how the sessions are setup, which is usually hidden.

    • @danielhenderson7050 says:

      I thought the exact same

    • @WarttHog says:

      Yeah totally!

      It’s super interesting that they told it not to make API calls as if they expected it would if Internet access wasn’t disabled.

      Part of me wonders if Internet access is really disabled or if they just disable it by convincing ChatGPT not to try! 🙂

    • @apache937 says:

      @@WarttHog of course it is. it wouldmake the python scripts try to use external apis

  • @Alex-gc2vo says:

    Plotly deserves most of the credit here. Those plots are exceptionaly easy to make thanks to their library. We also need to be very careful here. There’s no way to tell how much insight the model is extracting from the data and how much it’s useing its pretrained knowledge. If the data contradicts its knowledge which will it tend to believe?

    • @aiexplained-official says:

      It will say ‘according to data X’ but also it is known that Y

    • @w花b says:

      Now ask the source

    • @Muskar2 says:

      You should never use it to verify itself, or trust that it has predictable behavior regarding to how its sourcing its knowledge. It can easily make something up that sounds plausible. If you’re not skilled in the field you’re prompting it, you can use it as a hypothesis generator and then try to verify (or ideally try to disprove) it. Ever heard that Wikipedia is unreliable? Well, GPT is even less reliable. And just because it sometimes lies or denies capabilities, doesn’t mean that it can’t do the exact task correctly in some other prompt context. It’s very quirky like that.

    • @TateVanPatten says:

      Yes plotly is goated

    • @GuinessOriginal says:

      @@aiexplained-official is it accurate in its use of data, interpretations and maths? I’m wondering how they’ve solved the hallucination problem.

  • @samwolfenstein5239 says:

    It’s funny, those tasks it completes successfully in this video are essentially the exact same as those I was assigned in my final semester as a Business Administration major. It performs the same data analysis and creates the same visualizations and explanations that I had to, at a quality level not much worse. I graduated less than a month ago, and with AI already having started its recent explosion a couple months prior to that, I estimated at the time that it would probably be only a few months until it could reliably do everything they spent four years teaching me.

    So far it’s looking like we’re ahead of schedule. It’ll take some more time to work out the kinks and make it more reliable, as well as enable more robust analyses, but I suspect by the time I start my new job (roughly one month from now), it’ll be capable of that. Exciting times

    • @samuelkibunda6960 says:

      You’ll probably be using it in your work I highly doubt people in the corporate ladder would want to be handling such mundane tasks

    • @ToriKo_ says:

      Jeez

    • @maxidaho says:

      You do understand that the job you just spent a lot of time and money working towards is now in jeopardy…right? I’m such a bummer.

    • @samwolfenstein5239 says:

      @@maxidaho Oh, it’s not just in jeopardy, it’s going to be virtually nonexistent soon enough. Not much you can do but prepare for the degree to be useless

    • @theeternalnow6506 says:

      @@samwolfenstein5239 Yeah, it’s pretty brutal to watch unfold.

  • @hanskraut2018 says:

    I love the code interpreter a lot. And i loved to hear that the CSV file size does not seem to matter.

  • @kenneth7239 says:

    I’ve never thought a transformer model would be able to do this, looks like actual magic to me.

    • @puppergump4117 says:

      Aren’t human brains magic too

    • @elijahclaude3413 says:

      @@kmouratidis Indeed! At this point, these ‘GPT’ models are not even transformers, since devs have been integrating them with many other types of computing, machine learning, and other ‘AI’ systems.

    • @sampathkovvali6255 says:

      What is not understood is magic.

    • @gabe_owner says:

      @@kmouratidis The code would be pretty unimpressive and rather useless without the outputs of the transformers, though. Neither can be neglected, but transformers are the new thing between the two, and hence they’re more magic, or something.

    • @SiEmG says:

      same here, i didnt expect that from LMs

  • @incription says:

    This is the BEST channel for AI research and development. Thank you so much for putting the effort into these videos and not just reading off an announcement for 10 minutes. We really appreciate it!

    • @aiexplained-official says:

      Thanks my man

    • @iau says:

      I’ve said it before but I’ll say it again: AI Explain is just on a league of his own here in YouTube.
      – In-depth knowledge and testing
      – Quality and clarity of the presentation
      – Speed when putting out content

      He’s made every other similar channel obsolete for me. Bravo.

    • @LoftwahTheBeatsmiff says:

      I have learnt so much 🎉

    • @electron6825 says:

      I appreciate the lack of clickbait nonsense and hype-fueled misinformation.
      Other AI channels would have you believe AGI is already here.

    • @LoftwahTheBeatsmiff says:

      @@electron6825 I guess it is well on the way and I can see how we might arrive there but it still has to be applied, built and rolled out. Most people I know IRL still don’t know to Google something when they don’t know the answer.

  • @Thecrzyperson999 says:

    I’m a danish speaker. To me the poems makes sense. It reads a little weird, however that might just be me being unfamiliar with that style of poem. It is still very impressive, and i have found myself using gpt4 in my native tongue more often than i would have imagined.

  • @michaelmannion1963 says:

    My comment for your last video was that I couldn’t wait for you to test drive Code Interpreter – and you are again exceeding expectations!! Such a handful of “WOW!” experiments!! Would be awesome if you can you “go to town” on its Machine Learning capabilities! Muchas Gracias!

  • @derbytm3488 says:

    those plots are most likely created with dash/plotly, gpt 3.5 can still write code for that, but tbh its amazing that gpt4 can do that but lets not forget the people who created the libraries being used.

    • @urbanarmory says:

      Yeah, I recognized those plotting tools- while I certainly won’t sneeze at the convenience of AI automating the ingestion of their data and analysis, the plotting is all from existing open source tools

    • @kimsteinhaug says:

      I love when he says, maby its me thats easily impressed… YES; he is haha. (this time). But I agree, this plugin seems to be the one that actually is worth using for most of us normal people…. 😀 COme on, we had plotting libraries since the days of Flash… 😀

    • @urbanarmory says:

      @@kimsteinhaug my interpretation is that it’s the new SPSS- a great way to run simple stats and visualizations and explorations with minimal experience and not requiring spending half of your life hating R

    • @ko-Daegu says:

      @@kimsteinhaug how much the avg person really needs to create 3D scatter plots 😂

    • @tbird81 says:

      Yeah, that’s what libraries are for.

  • @DentoxRaindrops says:

    Love your channel mate, been watching since months and feel so hyped every time a new video is uploaded. Keep going, cheers!

  • @AICodingAdventures says:

    Wolfram Alpha can provide huge amount of real time data. Positions of planets in the Solar System etc., also it can do differential equations etc.

  • @Jaccused says:

    As someone who has had access to the code interpreter for a while I feel embarressed how much I underutilized it. This is some impressive stuff

  • @ShpanMan says:

    Just a note, The Wolfram Alpha counting prompt did not actually call/use Wolfram Alpha. If it did you would see the request and response in rectangles. Just because a plugin is enabled doesn’t mean it is used. I unfortunately know this as I’m developing a plugin at the moment and too many incidents of this happen to me :(.

    But your video is world class as usual!

    • @faizanahemad says:

      For plugin developers how does the chat-gpt interface look. I have been applying to develop plugins but no access for development yet.

    • @ShpanMan says:

      @@faizanahemad It’s the same as for any user. Though there were subtle hints that there are fewer rate limits on the chat.

  • @XetXetable says:

    Wolfram Alpha is, for the most part, an interface into a database + Mathematica. Any code that can be executed in Mathematica can be run in wolfram alpha. For example;

    LayeredGraphPlot[{4 -> 3, 5 -> 3, 5 -> 4, 6 -> 1, 6 -> 2, 6 -> 4, 6 -> 5, 6 -> 3}, VertexLabels -> Automatic]

    in Wolfram Alpha will draw the same graph (though formatted differently, and with extra information) as Mathematica. If you want to find a use for Wolfram Alpha that code interpreter can’t do, you need to find something that Mathematica is good at that Python is bad at. If code interpreter can import SymPy and/or Sage, then there will be a lot of overlap in terms of symbolic capabilities. But some things that come to mind is Integrals and solving differential equations, which sage is really bad at in comparison to Mathematica. Mathematica is also better at solving complex problems symbolically than sage. For more complex problems, wolfram alpha is more likely to succeed in finding a solution. I also imagine some data structure manipulation algorithms, like finding Hamiltonian cycles, would be easier with wolfram alpha since it has more robust support for graph manipulation than any python package I’m aware of, though I know that some Python packages can do it with some pain, so maybe code interpreter can do that. Unfortunately, I do not have access to code interpreter, so I can’t test these differences.

    • @mgscheue says:

      Funny, the first thing I tried with the Wolfram plugin was to give it values of miles between cities and have it draw a weighted graph and find the optimum cycle.

  • @jasoncawley7512 says:

    Re your comment at 12:12 about solving the math equation – I just used the Wolfram plugin and it got the right answer in about 10 seconds, including a plot of the solutions. If that didn’t work for you, I suspect it was just a case of GPT-4 not calling the plugin in the first place. “use wolfram” in the prompt tends to force that, I find.

    • @aiexplained-official says:

      Nice. I found wolfram pretty buggy, anyone else have that?

    • @mgscheue says:

      @@aiexplained-official Not so far. At least not Wolfram itself, but I’ve seen problems with ChatGPT handing incorrect information off to Wolfram. E.g. , I gave it a projectile motion physics problem and ChatGPT gave Wolfram the wrong signs for the initial vertical component of velocity and acceleration due to gravity, so the quadratic equation solutions for the time to impact were imaginary numbers.

  • @lynnqi6451 says:

    This is really mind-blowing! As you mentioned in the video, this is just the beginning, imagine this develops to a higher version, what it can’t do… Thank you so much to make this channel!

  • @user-ni2rh4ci5e says:

    GPT-4 with Wolfram Alpha finally got its only weakness cured. the way of GPT-4 using Wolfram looks more humanlike, it read the context of the problem and sets roughly the formula and logic that fit, (on its own without any assistance from Wolfram, it is pretty good at it) and then, throughout the Wolfram, GPT-4 evaluate and supplement the process to get the correct answers. the accuracy of getting it correctly has enormously enhanced compared to GPT-4 alone. even though It still makes a few mistakes, with only one more simple prompt, It could fix errors. Seeing GPT-4’s advancements, I’m 100% sure that one of the first massive replacements would happen in the educational field.

  • @krishp1104 says:

    The thing is with data it becomes harder to tell what parts of its output its hallucinating unless you analyze the data yourself

  • @Devsterinator says:

    Your videos are absolutely unmatched in quality, thank you so much for doing this research and sharing it with all of us.

  • @TTTrouble says:

    Have been waiting and neurotically refreshing the beta tab in ChatGPT in my settings tab ever since watching this video and was thrilled when I heard it was being pushed to everyone this week. Just had to come back to this video for inspiration on what to test, and cannot get over how freaking ridiculously cool this update is and the implications for the future.

    I could be wrong, but it really feels like Language Models doing novel research can’t be that much further out which feels like an inflection point for humanity.

  • >