August 25, 2024

> If I had more time, I would have written a longer rant. ~Some Dude 

If you deploy AI models to production you need to give a shit. Please, I beg of you. Stop wasting the compute, stop over-provisioning extremely expensive GPU nodes, stop wasting our time, stop …

August 24, 2024

There is a way of writing software that I have seen a couple times that I would like to call out. I don’t know if there’s a name for it, but here is the situation:

• You need to ship a lot of widgets to production
• Each widget is just …

August 19, 2024

I don’t know if this is a full thought, but I feel like the adandonment of execution speed in favor of shipping speed has lead people to not realize what they are missing out on with speed.

There is a quote that’s been making the rounds recently along the lines …

August 16, 2024

I keep coming across scattered resources on optimizing and making LLMs faster, so I’m just gonna build out a list of articles and resources I come across. All summaries are LLM generated. This is not garunteed to be up to date.

vLLM: Serve LLMs at scale

Continue Reading

July 11, 2024

I think what a lot of people have intuitively figured out, but haven’t noticed explicitly, is that using AI for greenfield projects feels much more useful than using it in an established codebase. From what I’ve seen, there are two main reasons for this:

1. Experienced engineers often work on …

April 28, 2024

Intro

This won’t be a full recap of my businesses. Even if I tried, the amount of nuance I can remember of projects that took years to complete in real time is very small. Every time I fail at anything I try to find some kind of silver lining in …

January 15, 2024

AI is really good at some things, but not so great at others. Predicting the future is a crapshoot if you don’t have good info, so this is my attempt at defining what AI is and is not good at in a broad sense, as well as some trends I’m …

May 17, 2023

I was born in 1996. Growing up, there were a lot of things that were considered to be Sci-Fi (or were outright laughed at) that are generally accepted as possible or probable today. Things like:

• Voice Assistants
• Broadly appealing electric vehicles that are more performant than their gas counterparts …

May 08, 2023

Seriously, how? Because nobody seems to be able or willing to dig deeper into how the development of programs can bring about the apocalypse. Here is a list of things which humans have catastrophically failed to predict about the onset of AI:

• Math, physics, and other formal logic systems …

April 13, 2023

I’m listening to the fully AI generated Joe Rogan interview with Sam Altman. As I’m listening to it, I’m coming to realize that I don’t care that it’s all AI generated. It’s still entertaining content.

I had a discussion about these kinds of clones with friends a couple years ago, …

December 05, 2022

Large language models (LLMs) like ChatGPT and GitHub Copilot have sparked a lot of debate in the programming community. While some people are excited about the potential of these powerful AI systems, others are worried that they will put programmers out of a job.

But the truth is that LLMs …

November 28, 2022

Whenever a new technology comes out that claims to revolutionize an industry, there are always people who focus on how it will destroy jobs. They’re right in a sense that it will destroy some jobs, particularly the ones that are no longer necessary because we’ve found a more efficient way …

August 19, 2022

Machines are mechanisms designed to augment human muscles. Some machines can have thousands of parts. If one part breaks, you may notice some reduced performance. When many parts break, The Machine stops.

That’s when the problems start.

The Machine is a mental mechanism I use to make my life easier. …

August 05, 2022

A robotic hand writing on a piece of parchment with a quill

The above image was created by the infamous AI DALL-E 2, by OpenAI. I recently was …

May 07, 2022

A group of professionals in suits, pixel art

A trend I’ve started to notice across many different disciplines is that when you deny the “majority” in favor of a high quality “minority”, you …

March 10, 2022

So for the past several months I’ve been mentoring a high school robotics team. In that time I’ve come to realize that there are remarkable similarities between running an FRC team and running a startup. Here’s …

I didn't break it, it was given to me broken

November 10, 2021

It would surprise me if I’m the first person to create something like this, let alone think of it. That being said, I’ve figured out a way to secretly embed a python …

It's easier than you think

August 31, 2021

The way programmers program programs are not always obvious when first starting out. When I was young and would see special effects in movies and TV shows, I would ask my …

Focus on the things that matter, remove the things that don’t.

August 26, 2021

An illustration of a desk with the following things on it: a laptop, coffee …

Continue Reading

A little perspective can go a long way

August 24, 2021

Marco shot of an expert blacksmith forging a piece of red hot steel. …

Continue Reading

...or unicode in a nutshell

August 22, 2021

A graphic image of 𒐫 and 𑇩 being swapped between two systems

We’ve been told time and time again that variables in Python must begin with a letter or …

There’s so much more to it than just the code

August 19, 2021

A stack of books on a library desk, god rays are shining through the dusty windows

Building your own Software as a Service (SaaS) startup …