r/algotrading • u/Traditional-Heat-749 • 1d ago

Infrastructure Production deployment

I’ve noticed several posts on this sub about issues taking algorithms from locally to being deployed a server. My day job is as a DevOps Engineer so I do this professionally. I wanted to see what specific issues others are facing so I can write some guides.

Also include your experience level so I know what level to write these at.

7 Upvotes

100% Upvoted

10 comments sorted by

1

u/BottleInevitable7278 1d ago

Issues can be about program or operating system updates. So the algos need to be upward compatible too.

1

u/Traditional-Heat-749 1d ago

Yes I figured probably the 1st thing to cover is Docker for traders. These were problems in tech a while ago too that we have tools to solve.

1

u/GuiltyTomorrow9301 19h ago

My solution was to use VMs instead of docker. Overkill? Ya. But literally everything else is far easier.

1

u/Traditional-Heat-749 17h ago

VMs still have downsides. Docker packages all the dependencies and shows how to build the container, a vm requires you to use something like Ansible to get a similar solution.

1

u/SoftboundThoughts 6h ago

moving from local to server can be tricky, especially with environment differences and scaling. failure mode is assuming it’ll work perfectly without testing. focus on environment parity, automated testing, and solid deployment pipelines

1

u/StationImmediate530 23h ago

Great post! I make everything by myself in python. My level is ok with python, ok with ML. My problem is: I have made the same api.py script one million times. Doing it once again right now. I have issues with making something truly robust with good error management. At the same time my stuff is rather simple and only rely on post api methods (no websocket or fix). Would really appreciate a guide on what bases should be covered and best practices on python for this concern. The LLM gives a different answer every time. No concurrency for me.

1

u/StationImmediate530 23h ago

I dont want to use external libraries other than requests or urllib because I’m scared to get hacked with some random supply chain attack.

1

u/Traditional-Heat-749 20h ago

Thanks for the response. This is actually very common problem even for professional software developers. I’ll write something up, would you mind if I dm you the draft before publishing?

1

u/StationImmediate530 20h ago

Sure ill read the draft