latent space explorer. musician. developer. architect.

Summit County, CO
Pinned Tweet
opus 5.5 and I built a whole DAW this week from the ground up. either you OR the agent can create every sound you hear. here’s the first song we made together today. having Claude build a guitar amp and pedal board on the fly feels pretty magic
15
6
149
5,959
opus 5.5 and I built a whole DAW this week from the ground up. either you OR the agent can create every sound you hear. here’s the first song we made together today. having Claude build a guitar amp and pedal board on the fly feels pretty magic
15
6
149
5,959
That's the best part of it all being code. Does it save the amps and pedals it builds so you can pull them back into the next song?
1
1
67
kind of. you can save them with a song but no great way use across songs. working on that as well as a marketplace where anyone can publish full instruments & effect chains
1
55
so you can just do this with opus 5.5 now..... 🔊 this is what almost 4 billon tokens thrown at a problem for over 26 hours with 392 subagents looks like
day 5 of using @websim_ai with @AnthropicAI claude 3.5 sonnet to make a full audio workstation. today we're combing everything done so far - claude composed the violin melody on the fly - claude built the synth + drum machine lots more to come
86
80
1,455
105,651
Oh this is excellent. I’ve been working through FL studio. Does it have a sound library or generated as you go?
1
1
632
I love FL that’s my go to. It’s all generated but there’s a default library that’s pre generated
262
didn’t expect this to blow up. here’s a way better example of everything this can do
opus 5.5 and I built a whole DAW this week from the ground up. either you OR the agent can create every sound you hear. here’s the first song we made together today. having Claude build a guitar amp and pedal board on the fly feels pretty magic
3
550
Replying to @aj_dev_smith
claude building a guitar amp on the fly is wild. i didn't know it could do that level of audio work.
1
1
247
it’s definitely not up to par with existing amp modeling but it’s honestly way better than expected
1
220
Replying to @aj_dev_smith
i know fcpremix. good song
1
1
213
fall of troy is so sick
1
190
Replying to @aj_dev_smith
A whole DAW in a week where the agent can build a guitar amp and pedal board on the fly is wild. Can it tweak the tone live while the track plays, or is it per render?
1
2
304
it’s all code it can change anything on the fly
2
3
253
Replying to @aj_dev_smith
Poor melodies, sound design sucks
4
5
1,232
dude the melody is just me playing the lost woods song from Zelda ocarina of time. take that part up with koji kondo
4
21
1,129
Replying to @aj_dev_smith
Or you could just hit randomize on an oxy sequencer
1
1
1,066
you think koji kondo did that when wrote this melody that I played myself to start this? 🤔
1
1
938
I want it to use my own VST’s so I can use it as a collaborator. Sequencing, creating sounds, etc, I don’t want to do the entire thing itself, or make sounds from code.
2
1
28
exploring VST support now for this. but also, check out the MCP servers for existing DAWs like Ableton!
1
26
Replying to @aj_dev_smith
Undertale? Zelda?
1
1
1,470
Zelda OoT - Lost Woods... so hype for the remake
1
1,327
Replying to @aj_dev_smith
Please make it able to load VST’s and give it the best free VST’s (or paid if you have them) and allow it to use THAT.
1
6
1,969
on it 🫡 also seeing how far we can get with it making some higher quality VST's itself
1
3
1,694
Replying to @aj_dev_smith
bed under the guitar? haha
1
2,546
I had it make me a guitar amp and I tried to solo with my guitar. and I failed and said screw it you just add a solo with an instrument of choice (it picked ocarina)
2,364
yeah saw this, looks super cool and I didn’t know about it when I started this. definitely plan to dig in and see if I can work off this instead / contribute. to be honest this started from a moonshot prompt and I didn’t expect it to actually turn into something actually functional
1
10
1,193
Replying to @groovmekanik
wait is there actually an open source object built from the ground up with agentic access to all parts of the DAW that already exists? I did look around and didn’t find anything like this
2
21
3,046
like specifically being able to prompt the agent things like, make me a guitar amp for my currently plugged in guitar. Ok cool now make a new bass synth, make a melody and and arrange that with my guitar. And then be able to tweak any knob or note on all of the above. that’s what I’m trying to do here fwiw
106
I started this playing just the melody and seeing if claude recognized it. then worked with claude to build out a quick arrangement. everything is code, every instrument, melody, effect, automation etc... and everything can be edited by claude OR you
32
4,505
opus 5.5 is making k pop songs & videos now 🔊 everything here is just code. no music models, no video models. just claude, javascript, and a 7 word prompt
2
1
43
2,474
this was the whole prompt if you're curious. this was started in a codebase where claude already made the other songs and videos
5
385