hlfshell

joined 1 year ago
[–] hlfshell@programming.dev 9 points 9 months ago

Boston Dynamic's robots are works of art - the pinnacle of engineering - but its all designed movement. By this I mean the control systems, their movement plans - it is built and designed by experts in their field. It's not quite as simple as "go from A to B and do some parkour on the way". There's a very large gap between "what is mechanically possible to do" and "Just let the robot figure out how to do that".

Mechanically we're ahead of software for manipulation and kinodynamic planning.

[–] hlfshell@programming.dev 6 points 9 months ago* (last edited 9 months ago)

I'm actually working on this problem right now for my master's capstone project. I'm almost done with it; I can have it generating a series of steps to try and fetch me something based on simple objectives like "I'm thirsty", and then in simulation fetching me a drink or looking through rooms that might have a fix, like contextually knowing the kitchen is a great spot to check.

There's also a lot of research into using the latest advancements in reasoning and contextual awareness via LLMs to work towards better more complicated embodied AI. I wrote a blog post about a lot of the big advancements here.

Outside of this I've also worked at various robotics startups for the past five years, though primarily in writing data pipelines and control systems for fleets of them. So with that experience in mind, I'd say we are many years out from this being in a reasonable product, but maybe not ten years away. Maybe.

 

I was aiming to use LLMs with robotics in an upcoming project, and needed to first verse myself in what is the current must-know techniques in the space. To that end I read a ton of papers and wrote this article to try and suss out the best parts of current state of the art.

I hope this helps people; I'd be thrilled to discuss much of this as well!

[–] hlfshell@programming.dev 4 points 1 year ago (1 children)

How're you liking the ID4? That and the ioniq5 are looking pretty good ATM... Though I wish the Honda E or ID3 was sold in the US...

 

Playing multiple co-op campaigns, and every druid across multiple campaigns experience, randomly, unexpected deaths when being knocked out of wild shape. Not death saving throws either - straight into full blown d-e-a-d.

Per the rules, it should go from wild shape -> spill over damage being removed from the remaining HP of the druid. Reading the combat logs we see that while enough damage is done to knock the druid out of their wild shape, the remainder is not nearly enough to put them into death saving throws, let alone outright kill them.

Is anyone else encountering this issue?

[–] hlfshell@programming.dev 2 points 1 year ago

One addition- sunlight is very bad for resin printers, so if your garage has windows or you routinely keep your garage doors open keep this in mind.

[–] hlfshell@programming.dev 1 points 1 year ago

I just finished my first long technical blog post - blogging is a relatively new habit I'm trying to build up. I posted the blogpost already to the robotics community so I'll just crosspost it with this link. TLDR it's the trial and tribulations I had while trying to use PPO to train a robotic arm to do pick and place.

I'm putting a hold on the other project I was burning out of - something I called coppermind (yes I'm a Sanderson fan) that handled chatbot memory/applications. I have an old version running on a digital ocean droplet plugged into Twilio, but recent degradations in ChatGPT 3.5 model response quality + that version not having my knowledge/vector database features means it's becoming a bit repetitive on its responses.

Right now with my masters in robotics starting up again in late August, and this being the project for the entire thing, I'm spending some time working on tooling to get myself up to speed on ROS2 and get repeatable environments up and running for it so I can quickly fix/deploy sim robots for the project. I have some ideas I'm toying with there. Unfortunately no idea what the project will be yet.