This marks the first beta release of Pydra, a distributed computing framework for python. While most core features are implemented, at least partially, there are many open tickets in the tracker for bugs and improved features. While this is not a stable release we felt the project was far enough along that there should be an installable package out there for people to experiment with. The coming months will bring more stability and features as we transition to a scheduled release cycle.
Many thanks to Jakub Gustak, Yin Qiu, and Almir Karic who have contributed code vital to this release.
Continue reading ‘Pydra 0.5 Released’
We’ve been working on Pydra for more about 6 months now and we’ve come a long way. So where is the project? Pydra is moving closer to a stable release, but there’s a lot to finish. We still expect to have something usable, by most people, by the end of the summer.
There are no releases yet but we’re getting ready to use it in production:
- We’re close to deploying Pydra with the Protein Geometry Project. I’ve been working bugs out of Pydra while implementing their protein data import tool. The main issues are related to the protein parser rather than Pydra itself.
- I’ve also deployed a small cluster of a few blades and other random desktop machines we had lying around. We’re throwing it at the Engine Yard Contest just to try out Pydra. The trial attempts have been good, but this was more about kicking the tires on Pydra than winning the contest.
SunlightLabs is holding a content called Apps For America to produce new applications that increase government transparency, openness, and accountability. RepresentMe is my entry into the contest.
What
RepresentMe (Repme.org) focuses on how well your representatives and senators represent you. It takes your opinions on bills and issues and compares them to how your elected officials voted. It applies statistics, accounting for how strongly you feel about specific issues and bills. The end result is a detailed breakdown of how well you are being represented.
Continue reading ‘Introducing RepresentMe’
Pydra is a distributed computing or cluster computing framework for Python. Pydra seeks to provide a solution that is easier to deploy, manage, use than existing projects. This is on top of providing standard features such as fault tolerance.
Pydra was born out of a necessity. Other projects being developed by the Open Source Lab required a large amount of processing. Rather than implementing parallelism specific to our application, we chose to build a generic distributed computing framework with the features missing in other solutions. We see Pydra as a useful tool for future projects at the lab.
Continue reading ‘Distributed Computing With Pydra’
If your website generates useful data a great way to propagate it is by providing widgets. A widget is a portable chunk of code that can be installed and executed within any separate HTML-based web page. By providing widgets, owners of other websites can display a small portion of your website, in theirs.
Building widgets is very easy, but building a widget editor and preview tool for each widget can be time consuming. I wanted to build at least a half dozen widgets for RepresentMe so I came up with a Generic Widget Builder. This tool will allow you to easily add new widgets each with their own editor and preview, requiring very little code.
Continue reading ‘Building A Generic Widget Builder’
Facebook, Twitter, and other social media websites, also called the new media, are becoming a major part of our culture. Facebook alone has 175 million active users. They are a means to reach broad audiences and build enthousiasm.
This tutorial is part 2 of a series that will focus on connecting your existing web application to Facebook. In part 1 we connected your website to a Facebook app. In this post I’ll show you how to update a users status and profile. I’ll be using examples from RepresentMe a project built for the Apps For America contest. This is a standalone webapp that leverages Facebook to deliver its message to a wider audience.
Continue reading ‘Connecting A Web Application To Facebook (part 2)’
Facebook, Twitter, and other social media websites, also called the new media, are becoming a major part of our culture. Facebook alone has 175 million active users. They are a means to reach broad audiences and build enthousiasm.
This tutorial is part 1 of a series that will focus on connecting your existing web application to Facebook. In this post I’ll show you how to connect Facebook accounts to accounts on your website. This will enable you to update a users status, profile and newsfeed. I’ll be using examples from RepresentMe a project built for the Apps For America contest. This is a standalone webapp that leverages Facebook to deliver its message to a wider audience.
Continue reading ‘Connecting A Web Application To Facebook (part 1)’
