How ChatGPT Will Restructure Engineering Teams & Create Opportunity for Startups
In the past, the core engineering team & the data science/machine learning teams worked separately. The core engineering team ships the product & focuses on reliability.
For most companies, the data science team analyzed data & wrote machine learning models to support the business functions : sales, marketing, customer support. These teams operated downstream of the data warehouse. But they are movin’ on up to work on products in front of the data warehouse.
ChatGPT has catalyzed an expectation in users’ minds that all products should converse with users & should be rather intelligent.
Data scientists’ expertise will be required to optimize the end-user experience : determining the right data sets to use to train models, understanding the best prompts to elicit germane answers (prompt-engineering), & model monitoring. They will need to be part of core engineering to achieve those goals.
The forces behind this change have been brewing for some time. Data science teams’ increased budget faces pressure from the office of the CFO to justify the investment. LLM-features should contribute directly to revenue via upsell & market share, quieting questions.
