AI is hard and it changes every week.
I myself was very slow to adopt it. and is still very slow on the rollouts.
One of the challenges with AI is that the models are not that cheap - especially the good ones. And if someone is paying $20 a month like 10 queries can cost $2 and that's a significant portion of that cost that was not there for AI.
If you want to give a query tons of context or run multiple queries to do a council of experts approach to reduce hallucinations or use more expensive models that do the stuff, then it gets even more expensive.
The models get better everyday though and they're so competitive that it's pushing on the pricing so I would give them a chance to improve.
but at the same time building AI product is hard. so it's good that you're giving them feedback so that they can learn as well
ultimately no one is going to have the magic product that solves all your problems so what you want to see is people taking feedback and iterating instantly and insanely fast so that you know that they're going to be giving you the best they can.
u/cglee wrote (the comment Michael replied to):
We still have our human TAs and nothing has changed or been removed. We've only added features with LSBot. We have students all over the world and those in, say, Asia timezone has to wait up to 24 hours for a human code review. LSBot now allows for immediate reviews. On top of LS
u/michaelnovatireplied·
I think it's good feedback to improve how LSBot is explained though in the product so people know what their options are and what the purpose of it is and don't make up their own story.
u/jhkoenig wrote (the comment Michael replied to):
I have no idea how that "students are still getting jobs" works. Any job, or a decent job actually as a developer? I see nothing on this or other dev subs that leads me to believe that bootcampers are landing dev jobs in any measurable volume.
u/michaelnovatireplied·
Yeah Launch School Capstone is the only program I'm recommending right now (for the right people), still posting transparent numbers, still holding themselves to 6 month placement windows.
Where is CIRR in all this. It's April and we haven't seen 2023 numbers yet when not so long ago we should have been seeing H1 2024 data....