You Suck At Deploying A.I. Models

August 25, 2024

> If I had more time, I would have written a longer rant. ~Some Dude 

If you deploy AI models to production you need to give a shit. Please, I beg of you. Stop wasting the compute, stop over-provisioning extremely expensive GPU nodes, stop wasting our time, stop …

Continue Reading

Ship Fast By Building Platforms

August 24, 2024

There is a way of writing software that I have seen a couple times that I would like to call out. I don’t know if there’s a name for it, but here is the situation:

  • You need to ship a lot of widgets to production
  • Each widget is just …

Continue Reading

Speed Kills

August 19, 2024

I don’t know if this is a full thought, but I feel like the adandonment of execution speed in favor of shipping speed has lead people to not realize what they are missing out on with speed.

There is a quote that’s been making the rounds recently along the lines …

Continue Reading

Really Really Fast Llm Serving

August 16, 2024

I keep coming across scattered resources on optimizing and making LLMs faster, so I’m just gonna build out a list of articles and resources I come across. All summaries are LLM generated. This is not garunteed to be up to date.


vLLM: Serve LLMs at scale

Continue Reading

Using Agents As Retrofit Solutions To Established Codebases

July 11, 2024

I think what a lot of people have intuitively figured out, but haven’t noticed explicitly, is that using AI for greenfield projects feels much more useful than using it in an established codebase. From what I’ve seen, there are two main reasons for this:

  1. Experienced engineers often work on …

Continue Reading

What I'Ve Learned From Two Failed Startups

April 28, 2024

Intro

This won’t be a full recap of my businesses. Even if I tried, the amount of nuance I can remember of projects that took years to complete in real time is very small. Every time I fail at anything I try to find some kind of silver lining in …

Continue Reading

Theory Of A.I. Proliferation

January 15, 2024

AI is really good at some things, but not so great at others. Predicting the future is a crapshoot if you don’t have good info, so this is my attempt at defining what AI is and is not good at in a broad sense, as well as some trends I’m …

Continue Reading

Impossible Things

May 17, 2023

I was born in 1996. Growing up, there were a lot of things that were considered to be Sci-Fi (or were outright laughed at) that are generally accepted as possible or probable today. Things like:

  • Voice Assistants
  • Broadly appealing electric vehicles that are more performant than their gas counterparts …

Continue Reading

How Will Ai Destroy The World?

May 08, 2023

Seriously, how? Because nobody seems to be able or willing to dig deeper into how the development of programs can bring about the apocalypse. Here is a list of things which humans have catastrophically failed to predict about the onset of AI:

  • Math, physics, and other formal logic systems …

Continue Reading

I Don't Think I Care About Fake Media

April 13, 2023

I’m listening to the fully AI generated Joe Rogan interview with Sam Altman. As I’m listening to it, I’m coming to realize that I don’t care that it’s all AI generated. It’s still entertaining content.

I had a discussion about these kinds of clones with friends a couple years ago, …

Continue Reading

If Computers Are Bicycles For The Mind, Then Llm's Are A Jet Engine For Programmers.

December 05, 2022

Large language models (LLMs) like ChatGPT and GitHub Copilot have sparked a lot of debate in the programming community. While some people are excited about the potential of these powerful AI systems, others are worried that they will put programmers out of a job.

But the truth is that LLMs …

Continue Reading

We Will Not Run Out Of Jobs Because Humans Are Greedy

November 28, 2022

Whenever a new technology comes out that claims to revolutionize an industry, there are always people who focus on how it will destroy jobs. They’re right in a sense that it will destroy some jobs, particularly the ones that are no longer necessary because we’ve found a more efficient way …

Continue Reading

Under No Circumstances Is The Machine Allowed To Stop

August 19, 2022

Machines are mechanisms designed to augment human muscles. Some machines can have thousands of parts. If one part breaks, you may notice some reduced performance. When many parts break, The Machine stops.

That’s when the problems start.

The Machine is a mental mechanism I use to make my life easier. …

Continue Reading

All Of The Images On My Blog Are Generated By An Ai

August 05, 2022

DALL·E 2022-08-05 11.53.18 - A robotic hand writing on a piece of parchment with a quill.png

A robotic hand writing on a piece of parchment with a quill

The above image was created by the infamous AI DALL-E 2, by OpenAI. I recently was …

Continue Reading

Curate For Quality

May 07, 2022

DALL·E 2022-08-07 11.10.09 - A group of professionals in suits, pixel art.png

A group of professionals in suits, pixel art

A trend I’ve started to notice across many different disciplines is that when you deny the “majority” in favor of a high quality “minority”, you …

Continue Reading

Similarities Between Mentoring An Frc Team And Running A Startup

March 10, 2022

DALL·E 2022-08-07 11.21.46 - A chalk drawing of a playbook.png

So for the past several months I’ve been mentoring a high school robotics team. In that time I’ve come to realize that there are remarkable similarities between running an FRC team and running a startup. Here’s …

Continue Reading

Sleeper Cell - A Method Of Embedding Invisible Programs Into Source Code

I didn't break it, it was given to me broken

November 10, 2021

DALL·E 2022-08-07 11.30.45 - An isometric view of a 3D rendered circuitboard, teal background.png

It would surprise me if I’m the first person to create something like this, let alone think of it. That being said, I’ve figured out a way to secretly embed a python …

Continue Reading

How To Think Like A Software Engineer For Beginners

It's easier than you think

August 31, 2021

DALL·E 2022-08-07 11.34.06 - 3D render of a brain with a confused face on it.png

The way programmers program programs are not always obvious when first starting out. When I was young and would see special effects in movies and TV shows, I would ask my …

Continue Reading

How To Program For 24 Hours Straight

Focus on the things that matter, remove the things that don’t.

August 26, 2021

DALL·E 2022-08-07 11.39.06 - An illustration of a desk with the following things on it a laptop, coffee in a thermos, speakers, and a notepad with scribbles on it. It's night tim.png

An illustration of a desk with the following things on it: a laptop, coffee …

Continue Reading

The Value Of Specializing

A little perspective can go a long way

August 24, 2021

DALL·E 2022-08-07 11.43.03 - Marco shot of an expert blacksmith forging a piece of red hot steel. The glow of the forge provides ambient lighting. In the background you can see a .png

Marco shot of an expert blacksmith forging a piece of red hot steel. …

Continue Reading

Why 𒐫 Can Be A Variable In Python But Not 𑇩

...or unicode in a nutshell

August 22, 2021

DALL·E 2022-08-07 11.45.33 - A graphic image of 𒐫 and 𑇩 being swapped between two systems.png

A graphic image of 𒐫 and 𑇩 being swapped between two systems

We’ve been told time and time again that variables in Python must begin with a letter or …

Continue Reading

What I Wish I Knew Before Starting My First Software Business

There’s so much more to it than just the code

August 19, 2021

DALL·E 2022-08-07 11.47.47 - A stack of books on a library desk, god rays are shining through the dusty windows.png

A stack of books on a library desk, god rays are shining through the dusty windows

Building your own Software as a Service (SaaS) startup …

Continue Reading

Newsletter

Sign up for email notifications whenever a new blog is posted!