To my surprise I see a repeating theme:
- ChatGPT generates ample amount of code that eventually runs after refinement through multiple prompts.
- Solution hits a hard edge case and we need to rework, refactor stuff, involving even more prompts to get it working (this is understandable as more tech debt is introduced)
- Solution hits an edge case and eventually ChatGPT4 starts hitting a loop saying it has a new solution or it fixed something but it really didn't.
- Manual inspection of code and simple logic removes that edge case from that solution.
To me this was an interesting to see: ChatGPT4 seems quite apt at handling requirements but it is unable to see very obvious mistakes or one liners.
I've spent about a week developing an iOS app with ChatGPT4 and these are my findings. I'm wondering if anybody else has experimented with generating code they have no experience or knowledge of and what your experience was like.