This marks the first beta release of Pydra, a distributed computing framework for python. While most core features are implemented, at least partially, there are many open tickets in the tracker for bugs and improved features. While this is not a stable release we felt the project was far enough along that there should be an installable package out there for people to experiment with. The coming months will bring more stability and features as we transition to a scheduled release cycle.
Many thanks to Jakub Gustak, Yin Qiu, and Almir Karic who have contributed code vital to this release.
Continue reading ‘Pydra 0.5 Released’
We’ve been working on Pydra for more about 6 months now and we’ve come a long way. So where is the project? Pydra is moving closer to a stable release, but there’s a lot to finish. We still expect to have something usable, by most people, by the end of the summer.
There are no releases yet but we’re getting ready to use it in production:
- We’re close to deploying Pydra with the Protein Geometry Project. I’ve been working bugs out of Pydra while implementing their protein data import tool. The main issues are related to the protein parser rather than Pydra itself.
- I’ve also deployed a small cluster of a few blades and other random desktop machines we had lying around. We’re throwing it at the Engine Yard Contest just to try out Pydra. The trial attempts have been good, but this was more about kicking the tires on Pydra than winning the contest.
Google is going to pay students $4,500 to work on some of the coolest open source projects. The OSU OSL is a organization for Google Summer of Code 2009. After reviewing some great proposals we’ve made our selections. Here are the students and the projects they proposed.
Continue reading ‘Google Summer Of Code 2009′
Pydra is a distributed computing or cluster computing framework for Python. Pydra seeks to provide a solution that is easier to deploy, manage, use than existing projects. This is on top of providing standard features such as fault tolerance.
Pydra was born out of a necessity. Other projects being developed by the Open Source Lab required a large amount of processing. Rather than implementing parallelism specific to our application, we chose to build a generic distributed computing framework with the features missing in other solutions. We see Pydra as a useful tool for future projects at the lab.
Continue reading ‘Distributed Computing With Pydra’
