AI Chatbot designed to answer Product Data Science questions (case studies, insights, metrics, A/B testing questions, GenAI data science). For additional information, how to log-in, best practices, etc. click here.
Instructions
To log-in, please use the same email as the one used to buy the Gen AI DS course . I would recommend going through the course before using this tool. Understanding how the model is built and knowing how to ask a question has a significant impact on the quality of the answers. The DataScienceGPT section of the course also provides some useful examples.
This model has been built almost exactly the same way as the one showed in this lesson. The main difference is that in that lesson I am just storing in the database the 40 product DS case studies. On the other hand, here the database is massive and consists of almost a decade of DS-related personal documents, notes, interactions with people with inside knowledge, and online material. The other difference is that this model uses GPT-4o instead of GPT3.5.
Re: how to ask a question, the main concepts in the course apply. When I played with this tool, I mostly used/tested it for two use cases:
1) Standard product data science job interview questions. My impression is that the model is suprisingly good in giving the right answer for a variety of questions. I mostly tested it on insights, feature development (should we test feature X), metrics, and A/B testing.
If you ask the model to guess something or hypotethical scenarios, at times the model returns 'I don't have this info'. If that happens, try forcing it to reply by adding to the question something like 'If you had to guess', 'It's fine if you are unsure. I just want a guess', etc. When it finally gives up and answers, the answers are often shockingly good.
2) Inside knowledge (e.g. can you list the key metrics at company X, can you describe how company X performs Y, how does company X defines Z, etc.). Most inside knowledge is related to the classic large tech companies that have hired a lot of DSs in the last decade: FB, Airbnb, Uber, Twitter, etc.
In this case, results are mostly hit or miss, depending on whether the information is there. If the model says it has no knowledge about it, try rephrasing the question using the company product type instead of the company name, e.g. messaging app instead of whatsapp (btw this is good advice in general).
For any feedback, feature requests, comments, etc., just email me at giulio@datamasked.com. Please, keep in mind that this tool is meant to (a) complement the Gen AI DS course and (b) help people learn about Product Data Science and, as a consequence, also get ready for interviews.