When Search Met AI: A Silicon Valley Romance Gone Wrong

You know that couple everyone thought was perfect? Well, the drama just escalated - enter SearchGPT

A Tale of Toxic Tech Relationships (Just in Time for Halloween)

You know that couple everyone thought was perfect? Well, the drama just escalated. Not only are Search and AI having problems, but now there's a new player in town: OpenAI's SearchGPT, the equivalent of launching a dating app while still in a relationship. And if you thought the drama was limited to OpenAI's leadership soap opera, buckle up – this relationship crisis runs deeper.

Why We're All Part of the Problem

Let's keep it real: you and I are the main culprits here. We all love a good shortcut and the promise of a silver bullet. "Reduce hallucinations AND get sources? Sign me up!" we say, eager for the next tech fix. The promise makes sense – search has evolved, becoming more conversational, and traditional engines struggle with this new language of asking questions.

So it makes sense, so much. But it's not that simple! When we work on combining search and LLMs within a company, that's where we need the most brainpower, the best technical and data talent, rigorous best practices, and a proper AI governance approach. So, even in a closed environment, not easy. 

This article, like the others here, is meant to be a fun and different way to think about how to use this tool. I'll be drawing on my background in psychology as well as math. After years in tech and business, I've learned that just because two things are great separately doesn't mean they'll work together. It's like that friend who seems perfect on paper but can be toxic in relationships. It seems we've been caught in a rather unhealthy relationship that requires some serious intervention.

The Perfect Match That Wasn't (A Silicon Valley Love Story)

Search engines, the established partner with decades of organizing the world's information, fell hard for the new hotshot in town - AI language models. Tech executives played matchmaker, convinced these two would revolutionize how we access information. Like many rushed relationships, the red flags were there, but everyone was too excited to notice.

A recent WIRED investigation by David Gilbert exposed just how toxic this relationship has become. When researcher Patrik Hermansson investigated debunked racist theories, instead of helping debunk them, AI-powered search tools eagerly promoted them. Google's AI Overview, Microsoft's Copilot, and Perplexity AI all confidently cited discredited research about national IQ scores, spreading misinformation like gossip at a toxic dinner party.

The Current Dating Scene (It's Complicated™)

Let's check in on our troubled couples:

1. Google Search + Gemini: The long-term couple in couples therapy. They're working through their issues publicly (points for transparency) and setting boundaries. Like that mature couple who posts about "growing together through challenges" on Instagram.

2. OpenAI + Bing: The messy breakup everyone saw coming. Both claiming they're "living their best life" while making the same mistakes separately. Bing's already on dating apps, while OpenAI just launched SearchGPT on Halloween (timing that should have been a red flag).

3. SearchGPT: The classic rebound relationship. Launched suspiciously close to the US elections, it's like that friend who jumps into a new relationship without processing the last breakup. Moving too fast, making the same mistakes, but with fresh marketing!

4. Perplexity: The startup that thinks they can "disrupt" relationships. They're that friend who read one self-help book and now thinks they're a relationship guru.

Great! We all know couples like this. They're great on their own, but together, they're a real challenge. Could the release of SearchGPT on Halloween be a hint at what we can expect from this couple? 

Why It's Actually Harder Than It Looks

Here's something I've learned helping implement these technologies inside companies: even in a controlled environment with the best talent and rigorous practices, combining search and LLMs is incredibly challenging. Why?

1. Technical Challenges:

   • Search engines are optimized for finding information; LLMs for understanding context

   • Combining them means managing two different types of errors

   • Real-time fact-checking against massive databases is computationally intensive

   • Source attribution becomes exponentially more complex

2. The Echo Chamber Effect: When one AI system confidently cites another, which cites another, you get a high-tech version of the telephone game. The WIRED investigation showed how all major platforms amplified the same discredited research, each making it seem more legitimate.

Real-World Implications (Beyond the Drama)

The timing of SearchGPT's Halloween launch, just before the US elections, isn't just bad timing – it's a warning sign. When these systems confidently present misinformation, they don't just spread false facts; they create an artificial consensus that can influence real-world decisions.

How to Stay Safe (A User's Guide to the AI Dating Scene)

1. For Casual Use:

   • Perfect for brainstorming and general queries

   • Great for exploring ideas and getting quick overviews

   • Use multiple services to cross-check information

2. For Professional Use:

   • Implement strict validation protocols

   • Maintain clear documentation of sources

   • Use dedicated research tools for critical information

   • Train teams on AI limitations and verification procedures

3. Red Flags to Watch For:

   • Suspiciously precise numbers without clear sources

   • Confident statements about controversial topics

   • Perfect, ready-to-use answers (life's rarely that simple)

   • Missing or circular source citations

What Needs to Change (And Yes, That Includes You)

It's not just tech companies' responsibility. As users, leaders, and implementers, we should do it in our own projects, even if it's “just prompting”:

1. Better Standards:

   • Source validation protocols

   • Transparency requirements

   • Quality control measures

   • User protection guidelines

2. Improve Your Best Practices:

   • Invest in proper AI governance

   • Focus on fixing core issues

   • Build proper foundations

   • Test thoroughly before launch

   • Prioritize accuracy over speed

   • Build verification into workflows

3. User Education

   • Train teams on responsible AI use

   • Clear limitations disclosure

   • Better error reporting

   • Transparent source tracking

   • Regular performance updates

It's Worse Than We Thought (But Not Hopeless)

What started as an exposé of racist pseudoscience has evolved into a warning about the future of information itself. We're not just watching one toxic relationship - we're witnessing the creation of a dysfunctional information ecosystem.

But unlike toxic relationships, we can't just swipe left on this problem. These tools are here to stay, and we need to learn to use them responsibly. It's time for tech companies, users, and implementers to stop rushing into bad relationships with technology and start building healthy, sustainable practices.

Remember: When tech companies rush to integrate AI and search, they're not just playing with code – they're playing with our ability to distinguish truth from fiction. And in today's world, that's a relationship we can't afford to get wrong.

All the best, Barbara

Update 03.11.2024: The Guardian, published an article, asking the same questions: “The chatbot optimisation game: can we trust AI web searches?” - very worthy read. If you want, we can dive deeper, just write me!

P.S. To tech executives: Maybe consider some pre-integration counseling next time? Just saying...

P.P.S. To all tech companies: Maybe try some relationship counseling before launching your next AI-Search hybrid? Just saying...

---

Author's Note: Written with equal parts concern for information accuracy and amusement at Silicon Valley's relationship drama. Any resemblance to actual toxic relationships is purely coincidental... mostly.

Source: Based on reporting by David Gilbert for WIRED, "Google, Microsoft, and Perplexity Are Promoting Scientific Racism in Search Results," published October 24, 2024, and personal implementation experience in enterprise environments.