
How data engineering fails

Join Starburst on April 17th for the next iteration of our Live Demo Series
Cindy Ng
Sr. Manager, Content
Starburst
Cindy Ng
Sr. Manager, Content
Starburst
At Data Universe, Benn Stancil took the stage to deliver provocative talk, drawing parallels between the evolution of internet and the current state of AI.
He highlighted how companies like Instacart, Netflix and Uber redefined their industries with innovative approaches. Just as Netflix transitioned from Blockbuster to streaming, and Uber changed how we think about transportation, AI is poised to revolutionize various sectors.
He emphasized, the success of the internet wasn’t merely about replicating existing systems online but reinventing them.
Back when we wrote about the strange new world of the internet, we’re seeing similar parallels with AI.
Surely, we are all aware of the story that unfolded before our eyes. When ChatGPT came out, it was the fastest growing website ever. Nvidia stock is soaring.
And so everybody has reacted to these last couple years by saying, “What if we took our products and we put a chatbot on it?”
Drawing from historical examples like Webvan, he cautioned against blindly adopting new technologies without considering their actual utility. Just as Webvan failed to replace traditional grocery shopping, hastily implemented chatbots may not address underlying problems.
He pointed out the current trend of applying chatbots onto products and cited examples like Zoom AI companion, Jira Virtual Agent, and Notion AI.
But we’re learning that AI requires a shift in mindset – it’s not about merely adding chatbots to everything, but about fundamentally transforming processes.
While initially promising, he warned that many of these implementations might not deliver real value. He likened this phase to the early days of the internet, where enthusiasm often outpaced practicality.
Early implementations of AI & chatbots are not actually working out because they’re not quite delivering valuable products right now and will required a more thoughtful approach.
As such he offers a few principles to guide your AI development
Avoid chasing trends for the sake of it; instead, focus on solving genuine problems.
Just as redesigning roads could facilitate self-driving cars, reimagining processes can unlock AI’s potential.
An example of this is Tom Cruise in Minority Report where we see redesigned roads for self-driving cars
Don’t underestimate the complexity; shortcuts often lead to subpar results. Instead, commit to thorough development and refinement.
An example of this is with OpenAI’s widget library. “Natural language to SQL widget” has 19 lines of code to “write a sql query for this question” that misses the mark on delivering what the user will really need.
Building effective AI solutions requires significant effort and time in the same way that Simone Biles masters a handstand.
Avoid products that prioritize showcasing AI over solving problems. The best AI is invisible, working behind the scenes to enhance user experiences and seamlessly integrate into users’ experiences
An example of this is Google’s magic eraser can erase people from photos and you don’t know it’s an AI-based tool.
By learning from past mistakes and embracing these principles, we can unlock AI’s full potential and create truly transformative solutions.
This site uses cookies for performance, analytics, personalization and advertising purposes. For more information about how we use cookies please see our Cookie Policy.
These cookies are essential in order to enable you to move around the website and use its features, such as accessing secure areas of the website.
These are analytics cookies that allow us to collect information about how visitors use a website, for instance which pages visitors go to most often, and if they get error messages from web pages.
These cookies allow our website to properly function and in particular will allow you to use its more personal features.
These cookies are used by third parties to build a profile of your interests and show you relevant adverts on other sites.