Tips and recommendations for using GPT by Andrej Karpathy (founding member at OpenAI) Tips
- Recreate system 2 thinking; slow and deliberate.
- Ask GPT for reflection when performance is not good; it knows it didn’t complete the assigned it just got unlucky in sampling.
- LLM don’t want to succeed. You want to succeed, and you should ask for it. You will be out of data distribution if you don’t ask the correct things.
- Offload tasks that LLMs are not good at are important: they don’t “know” they are not good.
- Ask GPT to respond in certain pre-defined formats (constrained prompting). Recommendations
- Use GPT-4
- Use in low-stakes applications, combined with human oversight
- Use it for the source of inspiration, suggestions
- Use prompts with detailed task context, relevant information, instructions
- “What would you tell a task contractor if they can’t email you back?”
- Retrieve and add any relevant context or information to the prompt
- Experiment with prompt engineering techniques (previous slides)
- Experiment with few-shot examples that are 1) relevant to the test case, 2) diverse (if appropriate)
- Experiment with tools/plugins to offload tasks difficult for LLMs (calculator, code execution, …)
- Spend quality time optimizing a pipeline (chain)
- If you feel confident that you maxed out prompting, consider ST data collection + fine-tuning.
First impressions of Vision Pro and VisionOS: You need to see it and hear it By John Gruber
- The overall technology is extraordinary and far better than I expected
- Vision Pro and VisionOS feel like they’ve been pulled forward in the future. I haven’t had that feeling about a new product since the original iPhone in 2007. Several aspects of the experience felt impossible.
- Apple is promoting the Vision Pro announcement as the launch of “the era of spatial computing”. That term feels perfect. It’s not AR, VR, or XR. It’s spatial computing, and some aspects of spatial computing are AR or VR.
- VisionOS is very much going to be a conceptual place like that for work. But there is no display. There are no boundaries. The intellectual “place” where the apps of VisionOS are presented is the real-world place in which you use the device or the expansive virtual environment you choose. With VisionOS, the virtual world is the actual world around you.
- In the same way that the introduction of multitouch with the iPhone removed a layer of conceptual abstraction — instead of touching a mouse or trackpad to move an on-screen pointer to an object on screen, you simply touch the object on screen — VisionOS removes a layer of abstraction spatially.
- This is not confusing or complex, but it feels profound. The constraints of even the largest physical display simply do not exist with VisionOS.
- The software as of today, is too far from complete, and, most importantly, the whole experience is too entirely new and mind-bending to render any such conclusion. But the potential for Vision Pro to be a compelling product, across several use cases, is obvious.
- That price is high enough that the answer is probably not, for most of you, no matter how compelling it is. But are you going to want to try one out for an hour or two, and find yourself craving another hour or two? I guarantee it. You need to see it and hear it.
Smart things Sam Walton (Walmart founder) said
- Our money was made by controlling expenses.
- Control your expenses better than your competition. This is where you can always find the competitive advantage.
- We always ran a real tight organization. We had no excess people.
- We just started repeating what worked.
- We were serious operators who were in it for the long haul. We had a disciplined financial philosophy and we had growth on our minds.
- I have always had the soul of an operator, somebody who wants to make things work well, then better, then the best they possibly can.
- We just got after it and stayed after it
- Many of our best opportunities were created out of necessity. The things that we were forced to learn and do because we started out under financed and undercapitalized in these remote, small communities.
- I like to keep everybody guessing. I don’t want our competitors getting too comfortable with feeling that they can predict what we’re going to do next.
- One thing I don’t even have on my list is “work hard.” If you don’t know that already, or you’re not willing to do it, you probably won’t be going far enough to need my list anyway.
- Go the other way. Ignore the conventional wisdom. If everybody else is doing it one way, there’s a good chance you can find your niche by going in exactly the opposite direction.
- I was never in anything for the short haul.
- A recovery day is when you’re so tired or under-resourced that you can’t do much of anything with yourself other than stay in bed / sleep a lot, binge on Netflix or video games, stay in your room all day, play with your phone, use social media, and feel unmotivated to do much except easy, stimulating, and/or mind-numbing things.
- Rest days are days when I have enough energy and resources to feel motivated and able to get out and about. (One way I can tell I have energy is that sometimes I spontaneously feel like cooking, a rare occurrence.) On a rest day, your prime directive is to “follow your gut” for the entire day and just do “what you feel like doing” in the moment.
- Rest days will actually refresh and reset you. Most use weekends and vacation days as recovery days or days where their mind is still in “working” mode. But recovery days alone are not sufficient for refreshing your energy levels and motivation. You risk burnout if you consistently fail to get any true rest over a long period of time.
- It makes a significant difference even just to a) hold it as your intention to rest for the day and b) let others know that this is important to you and that they would be impinging by making requests of you on a rest day. This is your time. You are allowed to set boundaries on your time, your attention, and your energy.
- Don’t expect anyone to be able to have perfect rest days. You may still have to check your email, and if a work emergency comes up, you will probably get pulled in.
- This kind of decision-making process doesn’t work as well for complicated things. You’re not going to try to buy a house this way. Or plan a party. Or do any work. But it’s a great way to know how to spend a rest day.
Others
- The things you own end up owning you. So buy well, buy once
- Twitter founders on Musk’s takeover
- Eating just 7 grams more fibre every day can cut your stroke risk and boost your overall health
Substack edition
Tips and recommendations for using GPT by Andrej Karpathy (founding member at OpenAI)
Tips
Recreate system 2 thinking; slow and deliberate.
Ask GPT for reflection when performance is not good; it knows it didn’t complete the assigned it just got unlucky in sampling.
LLM don’t want to succeed. You want to succeed, and you should ask for it. You will be out of data distribution if you don’t ask the correct things.
Offload tasks that LLMs are not good at are important: they don't "know" they are not good.
Ask GPT to respond in certain pre-defined formats (constrained prompting).
Recommendations
Use GPT-4
Use in low-stakes applications, combined with human oversight
Use it for the source of inspiration, suggestions
Use prompts with detailed task context, relevant information, instructions
"What would you tell a task contractor if they can't email you back?"
Retrieve and add any relevant context or information to the prompt
Experiment with prompt engineering techniques (previous slides)
Experiment with few-shot examples that are 1) relevant to the test case, 2) diverse (if appropriate)
Experiment with tools/plugins to offload tasks difficult for LLMs (calculator, code execution, …)
Spend quality time optimizing a pipeline (chain)
If you feel confident that you maxed out prompting, consider ST data collection + fine-tuning.
First impressions of Vision Pro and VisionOS: You need to see it and hear it
By John Gruber
The overall technology is extraordinary and far better than I expected
Vision Pro and VisionOS feel like they’ve been pulled forward in the future. I haven’t had that feeling about a new product since the original iPhone in 2007. Several aspects of the experience felt impossible.
Apple is promoting the Vision Pro announcement as the launch of “the era of spatial computing”. That term feels perfect. It’s not AR, VR, or XR. It’s spatial computing, and some aspects of spatial computing are AR or VR.
VisionOS is very much going to be a conceptual place like that for work. But there is no display. There are no boundaries. The intellectual “place” where the apps of VisionOS are presented is the real-world place in which you use the device or the expansive virtual environment you choose. With VisionOS, the virtual world is the actual world around you.
In the same way that the introduction of multitouch with the iPhone removed a layer of conceptual abstraction — instead of touching a mouse or trackpad to move an on-screen pointer to an object on screen, you simply touch the object on screen — VisionOS removes a layer of abstraction spatially.
This is not confusing or complex, but it feels profound. The constraints of even the largest physical display simply do not exist with VisionOS.
The software as of today, is too far from complete, and, most importantly, the whole experience is too entirely new and mind-bending to render any such conclusion. But the potential for Vision Pro to be a compelling product, across several use cases, is obvious.
That price is high enough that the answer is probably not, for most of you, no matter how compelling it is. But are you going to want to try one out for an hour or two, and find yourself craving another hour or two? I guarantee it. You need to see it and hear it.
Smart things Sam Walton (Walmart founder) said
Our money was made by controlling expenses.
Control your expenses better than your competition. This is where you can always find the competitive advantage.
We always ran a real tight organization. We had no excess people.
We just started repeating what worked.
We were serious operators who were in it for the long haul. We had a disciplined financial philosophy and we had growth on our minds.
I have always had the soul of an operator, somebody who wants to make things work well, then better, then the best they possibly can.
We just got after it and stayed after it
Many of our best opportunities were created out of necessity. The things that we were forced to learn and do because we started out under financed and undercapitalized in these remote, small communities.
I like to keep everybody guessing. I don’t want our competitors getting too comfortable with feeling that they can predict what we’re going to do next.
One thing I don’t even have on my list is “work hard.” If you don’t know that already, or you’re not willing to do it, you probably won’t be going far enough to need my list anyway.
Go the other way. Ignore the conventional wisdom. If everybody else is doing it one way, there’s a good chance you can find your niche by going in exactly the opposite direction.
I was never in anything for the short haul.
Recovery days vs Rest days
A recovery day is when you’re so tired or under-resourced that you can’t do much of anything with yourself other than stay in bed / sleep a lot, binge on Netflix or video games, stay in your room all day, play with your phone, use social media, and feel unmotivated to do much except easy, stimulating, and/or mind-numbing things.
Rest days are days when I have enough energy and resources to feel motivated and able to get out and about. (One way I can tell I have energy is that sometimes I spontaneously feel like cooking, a rare occurrence.) On a rest day, your prime directive is to “follow your gut” for the entire day and just do “what you feel like doing” in the moment.
Rest days will actually refresh and reset you. Most use weekends and vacation days as recovery days or days where their mind is still in “working” mode. But recovery days alone are not sufficient for refreshing your energy levels and motivation. You risk burnout if you consistently fail to get any true rest over a long period of time.
It makes a significant difference even just to a) hold it as your intention to rest for the day and b) let others know that this is important to you and that they would be impinging by making requests of you on a rest day. This is your time. You are allowed to set boundaries on your time, your attention, and your energy.
Don’t expect anyone to be able to have perfect rest days. You may still have to check your email, and if a work emergency comes up, you will probably get pulled in.
This kind of decision-making process doesn’t work as well for complicated things. You’re not going to try to buy a house this way. Or plan a party. Or do any work. But it’s a great way to know how to spend a rest day.
Others