• Superhuman
  • Posts
  • Why larger context windows are the next big thing in AI

Why larger context windows are the next big thing in AI

ALSO: New ChatGPT features and a historic moon landing

Read time: under 4 minutes

Welcome back, Superhuman

The next big thing in AI is here and it’s all about quantity — even if it’s lacking some quality. And Reddit looks to make the most of the AI boom, as the tenth most visited website in the US files to go public.

First time reading? Sign up to get this newsletter here


  • Reddit files to go public, as company looks to ride AI wave

  • Why larger context windows are the next big thing in AI

  • Chart: Proportion of top news websites blocking AI crawlers

  • How to translate videos with accurate lip syncing

  • 5 new AI tools to boost your productivity

  • AI Generated Images: Underwater houses


Today in AI & Tech

Image source: Intuitive Machines

  • Going Places: Space exploration company Intuitive Machines lands a spacecraft on the moon, in a historic first for a private company (pictured above).

  • Bigger Picture: Stability AI releases Stable Diffusion 3, its new image generation model that comes with a new diffusion transformation architecture and promises improved performance.

  • New Tricks: ChatGPT now lets you rate GPTs and provide private feedback directly to the builder.

  • System Down: Over 70,000 people in the US lose ability to call and text after provider AT&T experiences outage lasting several hours.

  • Good to Know: Apple says you shouldn’t dry your iPhone in a bag of rice, instead recommends users leave it out to dry.


Reddit files to go public, as company looks to ride AI wave

Source: Getty Images

Who knew tiny internet niches and odd hobbies would be a multi-billion dollar business? Reddit, apparently, as the self-proclaimed “front page of the internet“ files to go public with $800M+ in reported annual revenue.

Why it matters: Reddit reported over $200M in revenue generated from data licensing deals. Data is key to training models that power AI apps, and Reddit knows it has a ton of it. The company recently announced a $60M AI content licensing deal with Google that gives the search giant access to Reddit’s data.

Key details:

  • Reddit reported $800M+ in revenue for 2023, up from $666.7 million in 2022.

  • The number of global daily active users increased 27% in the 3 month period ended December 31, 2023, with an average of 73.1 million daily active unique users over that period.

  • The Wall Street Journal claims that the company plans to reserve an undetermined number of shares for its most loyal users.

  • The company believes future revenue increases will be driven by advertising and data licensing deals.

In an interesting revelation, news also emerged that OpenAI CEO Sam Altman owns 8.7% of Reddit's outstanding shares, and stands to make millions from the IPO.


Join AI leaders for GenAI Productionize 2024

Learn from top GenAI experts at GenAI Productionize 2024 – the one and only event on productionizing enterprise GenAI.

See how LlamaIndex, Coinbase, LinkedIn, Comcast, Proctor & Gamble, Roblox, Databricks, JPMorgan Chase, Fidelity, Chegg and more get their GenAI apps into production, including practical strategies for governance, evaluation, and monitoring.


Why larger context windows are the next big thing in AI

Sometimes bigger is better. Larger context windows — the amount of data an AI model or app can process — have been all the rage in AI this past week. And for good reason.

Google recently announced Gemini Pro 1.5, an improved version of its mid-range AI model that comes with an almost 8x larger context window than GPT-4 Turbo, OpenAI’s most advanced model. Even though Gemini Pro 1.5 isn’t as smart as GPT-4 Turbo, its ability to process more data unlocks many valuable new use cases.

Some users with early access reported success with uploading entire books into Gemini Pro 1.5 and getting accurate answers, while others shared screenshots of Gemini Pro 1.5 processing large audio and video files to generate responses.

“I think the AI community has underestimated the value of large context windows as a solution to many real-world AI problems,“ says Wharton professor Ethan Mollick. “Gemini Pro 1.5 is the first AI that really suggests a potential step up over GPT-4. It is not necessarily “smarter,” but the longer context window and ability to work with video expands the capabilities of LLMs in big ways.”

Gemini Pro 1.5 is currently in the final stages of testing and is expected to be released soon.


Proportion of top news websites blocking AI crawlers during 2023

Source: Reuters Institute

As more and more news organizations and content companies look to shield their data from AI companies, a new piece of research from Reuters Institute shows a sharp rise in the proportion of news websites across the world that are blocking AI crawlers from accessing and scraping their data.


How to translate videos with accurate lip syncing

  • Go to ElevenLabs and sign up

  • Select dubbing from the left tab and enter all the relevant details for the video you want to translate

  • Upload your video or insert a video link in the ‘Select a Source‘ tab

  • Select source language, target language, and the number of speakers

  • Press Create and wait for the video to be processed

  • Voila, you’re done! You can download your translated video if you wish.

For the example above, I used an English language video I found on YouTube and converted it into French.


5 AI Tools to Supercharge Your Productivity

Uizard: Generate UI designs from text prompts and edit them with an easy-to-use, drag-and-drop editor.

​​Dreamwriter: Design beautiful on-brand content that is built to perform.

MindStudio*: Build Powerful AI Applications with No Code [Free 2 Hour Workshop]

Talently AI: Ace your next interview and get instant feedback to improve your performance and become a top candidate.

Adsby: An AI co-pilot to create, analyze, and scale your ads for impactful results.

* indicates a promoted tool, if any


Underwater houses

Source: u/fuglafug on Reddit

Acquire new customers and drive revenue by partnering with us

Superhuman is the world’s biggest AI newsletter for businesses and professionals with 600,000+ readers working at the world’s leading startups and enterprises. Companies like Amazon, Calendly, and Notion feature their products in Superhuman. Main ads are typically sold out 4 weeks in advance. You can book future ad spots here.  

🧞 Your wish is my command

What did you think of today's email?

Your feedback helps me create better emails for you!

Login or Subscribe to participate in polls.

Reviews of the day

Thanks for reading.

Until next time!

p.s. if you want to sign up for this newsletter or share it with a friend or colleague, you can find us here. For questions and feedback, email us at [email protected]. We always listen and respond.