I gave it a harder test over at the chat site itself (chats not saved), like how to download the large data array from the OSM website. It knows quite a lot about writing the http request in the proper format, what data is contained in the array and it directed me to the appropriate API to use as well. It would have taken me a day or two to discover all that.
Got into some other nonprogramming subjects and there we had some trouble. I asked for a recipe to make Malaga Salad. GPT included black olives, red bell pepper and parslty. I suggested that it made a mistake, as they don't eat black olives in Andalucia and red bell peppers and parsley are rather strong flavours for cod, so seldom appear in the recipes. Maybe 1 in 10 to 15 recipes might mention those ingredients. GPT agreed that it made a mistake, apologised and revised the recipe. Caution is advised.
--Einstein gave the same test to students every year. When asked why he would do something like that, "Because the answers had changed."
