Ai Compounds

November 20, 2024

I recently made a claim on Threads that AI tools don’t just add value linearly - they compound, like interest. Each new AI tool multiplies the effectiveness of your existing ones. I was asked (quite reasonably) if I could clearly quantify this claim. I’m not going to promise perfection, …

Continue Reading →

You Suck At Deploying A.I. Models

August 25, 2024

> If I had more time, I would have written a longer rant. ~Some Dude 

If you deploy AI models to production you need to give a shit. Please, I beg of you. Stop wasting the compute, stop over-provisioning extremely expensive GPU nodes, stop wasting our time, stop …

Continue Reading →

Ship Fast By Building Platforms

August 24, 2024

There is a way of writing software that I have seen a couple times that I would like to call out. I don’t know if there’s a name for it, but here is the situation:

  • You need to ship a lot of widgets to production
  • Each widget is just …
Continue Reading →

Speed Kills

August 19, 2024

I don’t know if this is a full thought, but I feel like the adandonment of execution speed in favor of shipping speed has lead people to not realize what they are missing out on with speed.

There is a quote that’s been making the rounds recently along the lines …

Continue Reading →

Really Really Fast Llm Serving

August 16, 2024

I keep coming across scattered resources on optimizing and making LLMs faster, so I’m just gonna build out a list of articles and resources I come across. All summaries are LLM generated. This is not garunteed to be up to date.


vLLM: Serve LLMs at scale

A …

Continue Reading →

Using Agents As Retrofit Solutions To Established Codebases

July 11, 2024

I think what a lot of people have intuitively figured out, but haven’t noticed explicitly, is that using AI for greenfield projects feels much more useful than using it in an established codebase. From what I’ve seen, there are two main reasons for this:

  1. Experienced engineers often work on …
Continue Reading →

What I'Ve Learned From Two Failed Startups

April 28, 2024

Intro

This won’t be a full recap of my businesses. Even if I tried, the amount of nuance I can remember of projects that took years to complete in real time is very small. Every time I fail at anything I try to find some kind of silver lining in …

Continue Reading →

Theory Of A.I. Proliferation

January 15, 2024

AI is really good at some things, but not so great at others. Predicting the future is a crapshoot if you don’t have good info, so this is my attempt at defining what AI is and is not good at in a broad sense, as well as some trends I’m …

Continue Reading →

Impossible Things

May 17, 2023

I was born in 1996. Growing up, there were a lot of things that were considered to be Sci-Fi (or were outright laughed at) that are generally accepted as possible or probable today. Things like:

  • Voice Assistants
  • Broadly appealing electric vehicles that are more performant than their gas counterparts …
Continue Reading →

How Will Ai Destroy The World?

May 08, 2023

Seriously, how? Because nobody seems to be able or willing to dig deeper into how the development of programs can bring about the apocalypse. Here is a list of things which humans have catastrophically failed to predict about the onset of AI:

  • Math, physics, and other formal logic systems …
Continue Reading →

I Don't Think I Care About Fake Media

April 13, 2023

I’m listening to the fully AI generated Joe Rogan interview with Sam Altman. As I’m listening to it, I’m coming to realize that I don’t care that it’s all AI generated. It’s still entertaining content.

I had a discussion about these kinds of clones with friends a couple years ago, …

Continue Reading →

If Computers Are Bicycles For The Mind, Then Llm's Are A Jet Engine For Programmers.

December 05, 2022

Large language models (LLMs) like ChatGPT and GitHub Copilot have sparked a lot of debate in the programming community. While some people are excited about the potential of these powerful AI systems, others are worried that they will put programmers out of a job.

But the truth is that LLMs …

Continue Reading →

We Will Not Run Out Of Jobs Because Humans Are Greedy

November 28, 2022

Whenever a new technology comes out that claims to revolutionize an industry, there are always people who focus on how it will destroy jobs. They’re right in a sense that it will destroy some jobs, particularly the ones that are no longer necessary because we’ve found a more efficient way …

Continue Reading →

Under No Circumstances Is The Machine Allowed To Stop

August 19, 2022

Machines are mechanisms designed to augment human muscles. Some machines can have thousands of parts. If one part breaks, you may notice some reduced performance. When many parts break, The Machine stops.

That’s when the problems start.

The Machine is a mental mechanism I use to make my life easier. …

Continue Reading →

All Of The Images On My Blog Are Generated By An Ai

August 05, 2022

The above image was created by the infamous AI DALL-E 2, by OpenAI. I recently was given access to it and have been having all sorts of fun. But fun doesn’t always work to make people stick around. After all, the novelty can only last for so long. For a …

Continue Reading →

Curate For Quality

May 07, 2022

A trend I’ve started to notice across many different disciplines is that when you deny the “majority” in favor of a high quality “minority”, you tend to come out ahead. Some examples:

Light Fixtures

My first exposure to this concept was a few years ago when I was working at …

Continue Reading →

Similarities Between Mentoring An Frc Team And Running A Startup

March 10, 2022

So for the past several months I’ve been mentoring a high school robotics team. In that time I’ve come to realize that there are remarkable similarities between running an FRC team and running a startup. Here’s a quick list:

  1. Solve the problem as fast as possible – expect …

Continue Reading →

Sleeper Cell - A Method Of Embedding Invisible Programs Into Source Code

I didn't break it, it was given to me broken

November 10, 2021

It would surprise me if I’m the first person to create something like this, let alone think of it. That being said, I’ve figured out a way to secretly embed a python program inside of another without the embeded program being visible in the second program. It works like this:

Continue Reading →

How To Think Like A Software Engineer For Beginners

August 31, 2021

The way programmers program programs are not always obvious when first starting out. When I was young and would see special effects in movies and TV shows, I would ask my dad “How do they make special effects?” And he would respond “With computers”.

Despite being the most generic answer …

Continue Reading →

How To Program For 24 Hours Straight

August 26, 2021

Writing software takes a lot of focus, and unfortunately we can’t just snap our fingers and be instantly in the zone. It takes time, but there are a bunch of things we can do to help that along. This is a list of things that I’ve found over the years …

Continue Reading →

The Value Of Specializing

August 24, 2021

Last year after I shut down my first startup, I resigned myself to apply for jobs to keep me on my feet. I’d learned a lot over the course of the previous year, managing people, tons of web technologies, how to stick with a project for a long time through …

Continue Reading →

Why 𒐫 Can Be A Variable In Python But Not 𑇩

August 22, 2021

We’ve been told time and time again that variables in Python must begin with a letter or underscore, but that’s not quite the whole story. In fact, given how expansive unicode is, it’s almost none of the story. The truth is that as of Python 3.9 using Unicode 13 you …

Continue Reading →

What I Wish I Knew Before Starting My First Software Business

August 19, 2021

Building your own Software as a Service (SaaS) startup is a lot more than just writing a piece of software and sending it to your friends over instant message. There are a lot of pitfalls and nuances that I’ve dealt with over the course of building my own startup that …

Continue Reading →