Slightly Caffeinated

TJ Miller (00:00)
Welcome back to the Slightly Caffeinated Podcast. I'm TJ Miller. Yo, so what's new in your world, Chris?

Chris Gmyr (00:03)
and I'm Chris Gmyr

Hey TJ. yeah, last week took off, was off of work in between jobs. So a little just time to spend with the fam and originally was going to do like a bunch of house tasks and projects around here.

But we ended up getting a bunch of snow and snow days for Wednesday, Thursday, and Friday. we got probably about two to three inches Wednesday night. So it was like cold Wednesday. So they closed for the possibility of snow. It actually snowed Wednesday afternoon into evening into Thursday. And then it was just like snow and ice and whatever.

TJ Miller (00:29)
Holy smokes.

Chris Gmyr (00:49)
canceled it Thursday and Friday. So all of the tentative plans that we had to spread some mulch and do some outside stuff and build a couple more things all got thrown out the window and my son was home and no one could go anywhere. So it was just like a cobbled mess of everything. But kids had fun. We played outside and did a bunch of things in the house and whatnot.

It was pretty fun over the weekend. were able, everything kind of thought out enough Friday afternoon that we went to Myrtle beach, which is only about three hours way south of us for a little scout overnight. So that was Saturday night, but we went down because my cousin has a condo down there. So all of us and the dog went down there on Friday. We stayed overnight in the condo.

And then we had like a hike and a few other things with the scouts. And then my son and I went to an overnight at the aquarium down there at Ripley's aquarium in Myrtle beach. we, yeah. So we like brought in our, you know, overnight bags and sleeping bags and, you know, mats and stuff like that. And there's a part of the aquarium where you walk through this tunnel and the majority of it and above the tunnel, it's all.

TJ Miller (01:50)
so cool.

Chris Gmyr (02:07)
glass or plexiglass or whatever it is, you're in the aquarium with sharks and other fish and all that. So there's probably about 20 or 30 sharks in there. Like it's a massive aquarium and tank in this thing. And we just set up camp right in this huge tunnel, like 50 of us in there, because it went around like multiple rooms and areas and different parts of the tank and stuff like that. And we

went into the aquarium after hours. So it closes at eight or something like that. They let us in at eight. We got a tour. We got to see kind of behind the scenes, how everything works. And then around like 10, 10.30, we like settled down into the tunnel and aquarium thing and slept there overnight and got up, packed up in the morning and had breakfast and got my wife and daughter and.

Ours came with free tickets back to the aquarium. So we just bought one for my wife because the little one was able to get in for free and just went through the aquarium again for a couple hours and then went back to the condo. Little one took a nap. We cleaned up and packed up and headed home. So was kind of a busy weekend with a little bit of travel, but it was super fun and like a crazy cool experience and just being able to sleep with sharks is pretty sweet.

TJ Miller (03:02)
Yeah.

Yeah, that's so cool, man. I'm like ridiculously envious. Like I would love to go sleep with some sharks. that is what a cool experience, man. I'm I'm a aquarium enthusiast. Like I, I absolutely love it. I've been to Shedd Aquarium in Chicago like so many times and like every time I go, that's exactly like I want to go to the aquarium and check it out. So that is a that is a really cool experience, man. Glad you had a fun time.

Chris Gmyr (03:44)
Yeah, I'll have to,

yeah, it was super awesome. And hopefully a good core memory for him too. But yeah, I should throw a Google Photos album together and share you the link so you can see. Because I tried to take some videos, and I don't know if I can try and make it into a virtual iPhone background or something like that. I think that would be pretty sweet. So I got to look into that. But yeah, I'll send you the album link. Yeah.

TJ Miller (04:06)
Yeah.

Sick man. Yeah, I'd love to take a look. That's really cool

Chris Gmyr (04:14)
And then, so that was the weekend. then Monday morning started with the new job. So going through like the onboarding process and all that, trying to learn where I'm at and the new org and all that. But I thought that would be like a good topic to come back to after we hear what's up in your world.

TJ Miller (04:18)
Yeah.

Yeah, man. geez, my world, it seems super eventful, but also super boring. Um, just, uh, I I've been hitting the gym like pretty hardcore. I was, I started off like a couple of months, like two months ago, I think I started getting back to the gym and I was only going, uh, like two, three days a week. Um, really being wary of like injury. So it took me a little while to ramp up, but over the last like two weeks, I've been going like.

five days basically, really ramped back into things and I'm just, I'm loving it, man. I'm at that point where I'm starting to both see results mentally and physically, so it's extra motivating now, got results, great, let's keep going, let's get more results. And then also just the mental, emotional side effects of it have been profound.

Chris Gmyr (05:18)
Yep.

TJ Miller (05:24)
So just really living and enjoying that. Hit a really neat milestone with the Science Olympiad team this past week, We've been... I really don't have the bandwidth to put together a curriculum for them. So really what we've just been doing is going through Codecademy's Python course. Because that's the language they needed to know. I'm like, look, it's a curriculum. It's got all the things.

Let's just work through that. And so we meet an hour every week. We've missed like, I think, two weeks so far. So we're a little behind, but we had a like checkpoint in Codecademy to do a like review quiz and they got a 92%. They only got one wrong. So I was really tickled that that they got that good of a score. Cause I feel like

Chris Gmyr (06:07)
Nice.

TJ Miller (06:14)
I'm not feeling super confident and we've got a competition in like two weeks. So, we'll see how it, we'll see how it all shakes out, but I was really proud of them for, for doing that well on the quiz. And we dove into like conditional statements right afterwards and they seem to understand that pretty well. we'll, we'll do some review this week, but, you know, feeling a bit more promising than we were the week before that.

Like I basically pulled up the quiz and I let them walk through it on their own because they're going to be doing the competition independently. So I just pulled it up and left it to the three of them to work as a team and get through it. that was great. Other than that, man, we've had, we can talk about this a little more later. Big shipping weekend in Prism this past weekend. Kind of just taking what Taylor left us with at Lerakani U and trying to apply it of, you know, just

build stuff, ship stuff. So we can talk, like I said, we can talk about that a little bit more later, but big shipping week in Prism and then been making lots of progress on streaming output, which is by far the most requested feature right now. So making that a real big priority now that we got this epic of a refactor wrapped up. feeling really, really good about that right now.

Chris Gmyr (07:27)
Nice. That's awesome. Now, before we get into those couple topics, I put out on our podcast, Blue Sky account, there's any questions for us or anything like that, I'd love to hear more questions or just input from listeners and community in general. So if you want us to talk about really anything, like tech stuff, career stuff, general web dev,

TJ Miller (07:29)
Yeah, man.

for sure.

Chris Gmyr (07:51)
uh, more prism, more AI, more coffee, uh, whatever, you know, please, you know, hit us up. Um, but Andrew, uh, minion, um, hopefully I, I pronounced the last name right. He, um, responded and says, I'm still waiting to hear about the coffee. So we did a coffee update. I don't know, probably a couple months, probably too long ago at this point. Um, and at least for like my side, I think that's because I've been

TJ Miller (08:13)
Too long ago, for sure.

Chris Gmyr (08:21)
pretty boring recently. And I know we mentioned it on a previous podcast, before, at least me, if not the both of us, we're trying a bunch of different coffees, a bunch of different types of brew methods, and trinkets, and gadgets. And I've really cut down on a lot of that recently. And with the health stuff that I'm also still working through, I've really only been drinking one type of

coffee by one brand called Purity. they do, their coffee is all organic and they scan and make sure it's not, has any like pesticides or molds or anything else like that that I'm trying to stay away from because a lot of coffee and whole beans, it's like they have some levels of mold in that stuff typically. So there's not too many companies that

scan for all that and filter it out before they they bag it and you know sell it. So that's what I've been drinking probably for the last year and a half or so. At least at home like out and about like if I grab coffee like it's not you know that big of a deal but before I was getting from you know trade or doing a different subscription or just like you know checking out whoever you know mentioned something online it's like like I'll check it that out and

I think that introduced a lot of mold and issues that I kind of saw in my health journey too. So trying to pare back as much as possible. But the purity stuff has been really good. Even though there's not a lot of different types of coffees that they offer. And the two that I get is basically just different blends. So there's like a protect and then I've got the one, the flow I think.

So it's a blue bag or a brown bag. And I can put the links in the show notes, I've enjoyed them. They have a couple other ones that I haven't tried yet, but basically it's been pretty boring. And with the kids and running around in the morning, just throw it in a drip coffee pot. It's like a Bonavita, I think, or I might have to check on that. But it's a rain shower head and it keeps it at like 205 temperatures so it doesn't burn.

the coffee or get the water too hot. So it's just a nice decent cup of coffee. I was also thinking of like whipping out the Chemex over the weekends, have like a little bit more time like Chemex. I don't know, you just cannot beat that. And I used to do those all the time, get the kettle going, get the Chemex going and super great cup of coffee. just, you know, life and kids and fam, you know, events get in the way. So don't have a ton of time.

TJ Miller (10:33)
Mm, yeah.

Yep.

Chris Gmyr (10:49)
To do that and you know can't be doing a little like 2 30 in the afternoon or something like that anymore so Maybe I'll break that out over the weekend, but yeah, that's why I've been a little bit on the boring side of the coffee situation

TJ Miller (11:06)
Yeah, man, I hear you. I've been on the very boring side of things too. Still French press, almost exclusively. What we've been going through is Great Lakes Coffee Roasting. It's like a local roaster. And we did a like big bulk order from them. So we just got like a bunch of bags of whole bean. So we've just been kind of like going through that. with the political and

unknowns of stuff. We've been buying just a lot more stuff in bulk to have just like a surplus around in case things happen. So we got two like pretty big boxes full of like a variety of their like whole beans. So I think we've been eating our way through Sumatra at the moment. But, you know, it's solid, solid coffee. You know, and like we've said to you,

I think the big, like the number one thing you can do to have a better coffee experience is grind, like fresh ground. So like that's, you know, we, we have our grinder. grind everything right before it goes in the French press. so pretty easy. My, my birthday was this past week and, for a little birthday treat, I went out to a local coffee shop and, started to treat myself to a proper coffee and like my.

Chris Gmyr (12:00)
Yep, 100%.

Yeah.

TJ Miller (12:16)
My favorite going out coffee is a dry cappuccino. I love a dry cap. And I go in there and the last time I was somewhere and ordered a dry cap, they really didn't know what they were doing. So I went into this place. It's a little town, like a downtown area by us, Black Cat Coffee. Go in there and I'm like, you I want a dry cap. And they're like, well,

you know, have you had our caps before? I'm like, no. And they're like, we do like a traditional cap. I'm like, no, that's perfect. I'm glad. Like that's, that's, that's fantastic news. Like, yes, just make one for me dry, please.

Chris Gmyr (12:55)
Can you explain what a dry cappuccino is if people don't know?

TJ Miller (12:57)
Yeah.

So especially like if I'm not making it, like cappuccinos can typically end up a little bit more like a latte with foam. And for me, I prefer like only a little bit of milk and then foam. So it's like the espresso, a little bit of milk, like a splash, little splash of milk and then foam on top of that is really what I prefer. So that's like typically like when you have less milk.

Chris Gmyr (13:08)
Mm-hmm.

TJ Miller (13:25)
compared to the foam, that would be considered dry because it's less wet. Especially if the place has really good espresso, that's what I like. I've always liked that. I think if it gets a little bit closer to a traditional macchiato where it's just espresso and foam, but...

Chris Gmyr (13:31)
Yeah.

TJ Miller (13:49)
getting that little splash of milk in there, think is nice too. So I was it was great. It was fantastic. You can always tell too when they get it right and you pick it up and it's just like surprisingly lightweight. just you know, they got it. They got the ratios right. And I picked it up and it was just so tickled. The downside, though, is the pastry store next door that I love was was closed because it was also President's Day. And I think they were closed for the day. So.

Chris Gmyr (13:51)
Yep, totally.

TJ Miller (14:14)
little bit of a bummer, but gosh, that was so good to have like a proper coffee, you know? Fancy drink.

Chris Gmyr (14:20)
Nice. Yeah, that's awesome.

That's very similar to what I like getting to is a cortado, which is basically a shot of espresso and just like a little bit of steamed milk on there. And sometimes it's more or less depending on where you get it from. But usually it's just, I don't know, maybe a third or so or a fourth of the espresso. So it's just like a touch of milk in there and mostly espresso, which is nice. Or I just go for straight

TJ Miller (14:28)
Yeah.

Chris Gmyr (14:50)
espresso or like a double espresso. I know, because then you can really like tell how good the barista is, the beans, you know, how good their equipment is, all that stuff. So you can really, you know, find the good shops versus the not as good shops. So yeah, cortado.

TJ Miller (15:07)
Yeah, when you go in and

they have to explain to you that they do a traditional cappuccino and all of this, it's like, we're talking the same sphere here. Like, this is gonna be good.

Chris Gmyr (15:16)
Yep. Yeah.

Yeah. There's been quite a few of, because sometimes I'll mix it up, get a macchiato or whatever, they're like, this is a traditional macchiato, not like a Starbucks macchiato. It's like, yes, thank you, please. Yes.

TJ Miller (15:29)
Yes.

Yes. Before we move on though, I do, since you had mentioned putting that out on blue sky, I have to give a massive shout out to a friend of the show, Justin Jackson for reaching out. And he had listened to the episode talking about my woes with Clickhouse over at GeoCodeo. And he said that they recently had implemented Clickhouse at Transistor. And if I had any questions to hit them up, so I'm taking.

Chris Gmyr (15:49)
Yeah.

TJ Miller (15:56)
I'm taking them up on that. I reached out to John Buddha over at Transistor to start talking a little bit about their experience with ClickHouse and some of the things I'm running into. Because I feel like they're probably running into a similar or had to deal with similar situations. I'm sure they're tracking podcast statistics through ClickHouse. as you're getting lots of listenings happening, you're going to be dealing with

sure lots of little inserts, which is the same problem that I'm dealing with. And coming out of that conversation too, they also hinted to me that the boys over at Honey Badger are also using ClickHouse. So I'm going to be reaching out to them as well. It just goes to show how cool of a community can really develop around these different technologies. I think it was just...

Chris Gmyr (16:37)
Nice.

TJ Miller (16:46)
I was so tickled that he like listens to the podcast, but then also took the time to respond and hook me up with some hopefully like super solid info and help me get through what I need to get through with it. But that was super cool.

Chris Gmyr (16:59)
That's really awesome. Justin's fantastic. I chatted with him at Lyricon a while ago now, but just as cool as he is on all of his podcasts, YouTubes, everything, just have loved listening to him over the years back when he was doing like the Mega Maker stuff years ago, even before like Transistor. So I've been following Justin for so long and bought a bunch of his like early courses and books and stuff like that. So.

TJ Miller (17:16)
Yeah.

Chris Gmyr (17:25)
Justin Jackson, you're man. Keep it up. I don't know, love to have you on the show sometime.

TJ Miller (17:28)
Yeah.

Yeah,

we should absolutely do that. was just such a cool moment in community for me. That was great. So now that we've talked some coffee, I'd love to talk a little bit more about onboarding because I somewhat recently, I feel like there's still levels that I'm onboarding with GeoCodeo. just you get a big app and that does a lot of complicated things.

slowly kind of get exposure to everything over time. So I still kind of feel like there's there's onboarding that I'm doing there and you're you're now in the throes of onboarding somewhere new as well. I'd love to just talk a little bit about like positive and negative onboarding experiences or really really whatever. I just want to talk a little bit about onboarding.

Chris Gmyr (18:03)
Yes.

Yeah, totally. Well, it's just, I think, a totally overwhelming time for a new hire coming in, especially, I don't know, I've always been an engineer, so it might be different for other departments. jumping in, it's like, I want to start pulling down repos and setting up IDEs and start pushing code day one. And it's like, slowly roll.

TJ Miller (18:36)
Yeah

Chris Gmyr (18:37)
get through the basics a little bit. so I've been trying to go through more of the HR company-wide stuff, just understanding the company, the different levels, what the different departments do, the patients and users go through their experiences. And where I'm at now, they have done a fantastic job of setting up all of these trainings. And there's video courses and written documentation.

They do like little quizzes at the end and it's not like too overwhelming. It's just a lot of good information in there, but it is just a lot. And then you jump into like the HR things that need to get done. like resetting up like health insurance and like FSA and you know 401k and you know all that stuff that we actually just went through at Coreology at the end of the year because we switched a bunch of different companies. So we had to do all that again, insurance companies. So

TJ Miller (19:13)
Yeah.

Chris Gmyr (19:30)
Feeling like I just went through that and then having to do it again, you know, is not ideal. But it's like, yeah, getting quicker at it. So not as many decisions to make. But yeah, and then just the documentation is a lot. They've done a great job where all the teams, all the engineering team as a whole just writes everything down. So they have team structures and

TJ Miller (19:30)
Yeah.

Yep.

Chris Gmyr (19:53)
Like each team has different charters and what they're responsible for. All the teams have different docs and all that. So you can jump into all of their different team level areas in Confluence. So they recently moved from Notion to Confluence to get into the Atlassian ecosystem. So some things are still in Notion and some things are still in Confluence, which is a little weird jumping back and forth.

but super detailed information on how you pull this down, how you connect to all these different things, what the current architecture is, at least the simplified version. Here's the future state of where we want the architecture to be and how we want these services to interact. And there's just tons of things to learn. And also, my team is brand new. My engineering manager is brand new. I'm the first hire on the team.

Two more people are coming in over the next couple weeks, and then we're still hiring for a few other people after that. So there's not anyone that I can talk to in the closer knit team that I'm on that knows a lot. So I have to go much wider. And that's not really a problem, but sometimes it's like, you're working with someone right next to you in the same team and knows the same things that can

teach you more quickly. right now it's just like, well, you got to talk to this person over here on this team and this person up here. so it's just figuring out all the people that you need to know and connect with and who to continue to keep in contact with as the onboarding journey grows. But everyone that I've talked to so far and worked with and chatted with has been really fantastic. So I think the

TJ Miller (21:11)
Mm-hmm.

Yeah.

Chris Gmyr (21:35)
cultural side of onboarding too, because it's not like you're just jumped into this space of ongoing work and whatnot and not having a lifeline. So I think culture is really big with onboarding as well. And if you can feel comfortable enough to reach out and everyone's super helpful and not like, ugh, the new guy, he doesn't know anything, and worrying about like, like, did.

TJ Miller (21:56)
Yep.

Chris Gmyr (21:59)
Was I a good hire for them or all that? So try not to get too ahead of myself or down on myself or I don't know, not going as fast as I would want to or going as deep as I would want to, but it's only day four. So I'm trying not to be too hard on myself. And I think we chatted before. I just dive in 150 to 200 % and want to be, I don't know, just the.

TJ Miller (22:15)
Right.

Chris Gmyr (22:28)
prime employee and engineer. So trying to taper that down a little bit, take my time, not get too burnt out, and still continue to focus on other things outside of work, which is obviously really important too. So they've been great so far. And hopefully I'll have a little bit more to dive into over time. But I think docs are great. Videos are even better, at least for me.

and connecting with the team and doing one-on-ones and all that has been really helpful.

TJ Miller (22:59)
Yeah.

Yeah. You nailed it, man. It's just, no matter how you cut it, it's just a very overwhelming experience. And I still feel like I could, I wish I could just like Matrix download everything and just have an understanding of everything that's going on so I can like maximize my contributions. Like I just, love being able to like get to that point where I can freely contribute to different things without.

Chris Gmyr (23:12)
Yep.

TJ Miller (23:23)
you know, first having to go like understand the thing and then, then sort of start working on the thing. you know, everybody at Geocodeo did such an amazing job. Like I'm still kind of taken aback how amazing the onboarding experience was there. Like there was stuff for me to work on day one. I was able to get some quick wins in. you know, we did a great overview of like the complicated stuff without getting

two in the weeds about it. it was, it just, probably the, the, the best onboarding experience I've ever had. Um, so I'm super thankful for that. And, um, it sounds like you're heading into a good one too. Like, uh, I I'm with you. I prefer video content, but just having all of those docs available is, uh, really important. Um, I think it's going to lead to like a solid onboarding experience for sure.

Chris Gmyr (24:15)
Yeah, 100%. So yeah, looking forward to learning all the new things. also, onboarding is not just the first couple days or first week or even first month. It's like this is a three-month-plus journey. And even in Curology, our last place, I was there for almost six years. And there were still parts of the code base and the business that I never had to touch, need to know about, really. I just knew that.

TJ Miller (24:30)
Yeah.

Chris Gmyr (24:42)
This other person worked over there, so if I needed to ask any questions, going over there. But it's just an ongoing journey just with web dev and programming in general. It's like, know what you know, and you're always going to be learning and trying out new things and seeing what works and just the journey.

TJ Miller (24:57)
Yeah.

And I mean, on top of it all, like you've got a little bit of a different transition into onboarding experience too, because you're coming from PHP and Laravel and you're heading towards something that's a little bit more Ruby heavy, right?

Chris Gmyr (25:12)
It's some Ruby they have like an old monolith or a couple of old Ruby apps, but a lot of it is going to be like no TypeScript JavaScript type technology, either front end or back end. So yeah, lots of, lots of new things across the board.

TJ Miller (25:18)
Okay.

It's not so bad then, yeah. Yeah, new things,

but if you were like, think more significantly needing to invest in like Ruby and Rails, think that'd be, that'd make things a little bit harder, but considering you've got Node and TypeScript experience and it's not gonna be, I think too bad then.

Chris Gmyr (25:42)
Yeah, yeah.

TJ Miller (25:43)
Cool, man. I'm looking forward to hearing more about your journey onboarding. Yeah, I'm really excited for you to be able to like start something new coming from where you came from. So definitely excited to hear more about it. And yeah, dude, we'll see where it goes.

Chris Gmyr (25:58)
Yeah, I'm excited too. So let's hear some more about Prism updates.

TJ Miller (26:02)
man,

Prism. So we've talked about this like pending refactor at Nausium for several episodes over since the beginning, I think. And the big refactor being the way that, the way that things worked in Prism was you had your, you, we'll take it from like,

Chris Gmyr (26:09)
Yep.

TJ Miller (26:23)
a partial refactor that I did. we had, you would call, for text generation, you'd call prism double colon text, that returns a pending request, then you call generate, that pending request ends up calling a generator class, not like generator generators, but just conceptually a generator. And that generator handled the whole like request life cycle of invoking tools, sending tool responses back, generating the final response, but it went

your text method to pending request to generator to provider. That's kind of the like the chain of how everything was called. And the big refactor was going from, you know, the text method to pending request directly to provider. So we essentially cut out the whole generation step in the middle. And the reason for doing this was initially I really liked the concept of having a central place.

put all the logic that just worked with abstractions to handle the whole request lifecycle. Well, the more providers were out supporting and the more provider specific features that we're looking to support, having a central place to try to organize all of the customization that a provider, like you may need to do to make a provider work was just starting to get really complex.

and or limiting the ability for us to implement certain features. So by eliminating that generator, we now give all of the providers like a insane amount of customization in like their request life cycles. Part of that problem that I always got hung up on was trying to make the providers not get too complex. You know,

there's definitely going to be some duplicated logic between a bunch of providers. But I just had to get to a place where I got over myself, got over being weird about it, and just let providers be as complex as they need to be. And ultimately, then the providers are responsible for the final response of a text response or a structured response or anything like that. So I decided to...

Chris Gmyr (28:09)
Mm-hmm.

TJ Miller (28:25)
Instead of just take the undertaking like on by myself, which would have been weeks of work, I decided to write up an issue in GitHub, just explaining what the change is, why we're making the change, and then kind of put that out there for like call for help. Like I'd love some help on making this refactor. I went out and did refactored Olamma first and had that like.

was able to like publish that as an example of like, here's how I think providers could and should look and function. So I got one out of the way and I am just so thankful to Chris and Pushpack. They came in for the win and we were able to knock out the entire refactor over a weekend, basically. So something that definitely would have taken me a week to two weeks of work to do. Some outside contributors came in and we just like knocked the whole thing out in a weekend.

Chris Gmyr (29:04)
Wow, amazing.

TJ Miller (29:13)
which was, it was a profound experience for me. Like this is, it still just feels like this like little passion project that I'm out there working on and seeing people like, not only use it and like put it in production, which is wild to me, but also like take time out of their lives to like make meaningful contributions back to the project. it, means.

the world to me. It's just so cool. Like it's crazy to come in here and look at that we're at 970 some stars. We're a little over 40K downloads. We just hit version 0.40. You know, it's I can't, I can't believe like the project is at where it's at. And I'm just, I'm really thankful for it.

Chris Gmyr (29:58)
Yeah, that's some great growth and also just the community involvement too, because the transition from Sparkle to Prism happened at like the last quarter of last year, right? So it's not like even Prism in its current form has been out a year or two even. So it's only been a few months really, like a lot more.

TJ Miller (30:14)
Yeah.

Chris Gmyr (30:25)
because you were talking about Sparkle and doing something a little bit different before that. But it's just amazing to see that in only a short timeline that so much involvement has been going on with the package and the community and all the updates has been pushed to it. It's just awesome to see.

TJ Miller (30:44)
Like just looking it up, I tagged the initial release on October 7th of 2024. So yeah, that's just crazy, And then now that that refactor is out of the way, it is turning.

turned my focus over to streaming output, is, I think, by far the most requested feature right now. There's a lot of people really looking forward to streaming output. So now that that very factor was out of the way, I was able to turn my focus to it. I think I've got it nailed down for OpenAI. So game plan is to finish out. I'm actually probably going to merge it today. Basic streaming output support for OpenAI.

And then I think the game plan is going to be, I'm going to release it for OpenAI, Anthropic, and Olamma. Because those are my real three core providers. So I'm going release it for those and then probably just rely on contributions to add it for any other providers. So I can just get like.

focus on getting those things out and settled because there's going to be some time afterwards where people start using streaming that I'm going to have to adjust things, maybe enhance some stuff. But really happy with the way it's turned out so far. So we're firing on almost all our cylinders right now. So very excited about getting streaming done. Somebody had reached out on Twitter, Tony Lea.

And he had said, if I got streaming output for OpenAI done this week, he'd screencast something about it next week. So definitely making the push to get it done this week to see what he comes up with. So very exciting stuff. then something I did a little bit different for this one too was I was a little bit more, especially with newer features like this, I tend to keep them a little bit closer to the chest on working on them and just kind of

Chris Gmyr (32:13)
sweet.

TJ Miller (32:33)
Exposing like a P like opening up a PR when it's like mostly there. I I took a little bit different approach I opened up a real early PR and shared that out with like hey, here's the initial progress on Streaming it's like it's functional if you want to take a look at it and it was cool Someone on the PR said yeah, I already pulled this down and played with it. It works great Had it and like followed up with like a suggestion on it. So I Think that was kind of cool to just taking a little bit different approach and just getting

Chris Gmyr (32:51)
Yeah.

TJ Miller (32:59)
something a little out there a little bit earlier than maybe I was comfortable with, but was able to get some feedback on it quickly too to help kind of like guide the rest of it. So that was, that was cool. I'm really excited how that's going.

Chris Gmyr (33:10)
Yeah, love that. Is there anything you need from the community or need help on or want to call out?

TJ Miller (33:18)
You know, right now, getting streaming out there, just people using it and getting feedback in, I think is going to be the next big step because I don't necessarily have a personal use case for streaming. It's nice for when I do have like, I have custom agents that I chat with on a daily basis to do coding work and other things. So I have

I have a loose need for streaming. Like I have no problem sending the request and waiting for the response to come back. But there seems to be a lot of other people wanting streaming for the things that they're building. So because I don't have a like super direct use case, having other people really spend time with streaming and get that feedback in, I think is going to be super important. But other than that, yeah, just keep an eye on issues like

Chris Gmyr (33:58)
Mm-hmm.

TJ Miller (34:10)
I'll definitely tag stuff with help wanted where I'm looking for help and feel free to dive in. I'm always open to different contributions and code improvements, especially docs. I'm so thankful for anybody who puts time and effort into the docs. Like that's a really meaningful space for me. So yeah, reading docs, if you see anything or feel like they could be enhanced somehow, like absolutely hop in and open up a pull request. Like I love that stuff.

Chris Gmyr (34:33)
Yeah, awesome. Cool. You want to wrap up?

TJ Miller (34:35)
So cool. that note, you want to... Yeah, perfect.

So thank you everybody for listening to the Slightly Caffeinated podcast. Show notes, including links of things we've talked about and all our social channels are available at slightlycaffeinated.fm. Thank you all for listening. We'll catch you next week. See you.