Where are the Rails infrastructure support firms?

Posted on Nov 10, 2010

Where are the Rails infrastructure support firms?:

“Five years ago, the typical Rails stack was just a couple of pieces: Apache/Mongrel, Rails, and MySQL. While Rails is remarkably similar to its original form even today, the stack around it is dramatically more diverse. We’re deploying to automated infrastructures, using NoSQL databases, messaging systems, queuing systems, and more. With the increased complexity of web applications, I’m surprised we’re not seeing companies dedicated to 24/7 infrastructure support: it doesn’t matter where your app is hosted, they manage it.”

This is an area of great interest to me; I am fascinated by the marketplace. I share my skepticism about the form of the business described herein, but have heard of a company or two in the space. The primary issue I see is drawn from my own experience.

I was the lead developer for an application that grew large on my watch. My recollection of the message coming from presentations in the Rails community at the time was “Learn to be fast when you need to, because you probably won’t need to.” While this may be accurate since most projects are failures, it serves you poorly if you later learn that performance is important to you. It deals with capacity (another critical concept, especially in Rails) not at all. I wouldn’t be surprised to see the two equated by the community at large.

So what are the results of this message? Developers are writing applications that can get them into trouble– “design by laptop” has claimed many a deliverable, just that I’m aware of personally. They’re not familiar with operations. Their systems do not count on failure as an outcome. The architecture is poor. Many don’t know that there is a solution. Those that do scratch and claw to find one find that, unlike their development experience so far, tools and systems to increase capacity and performance require a great deal of knowledge to plan for their use. It is a complicated field requiring great study, and some mind-bending. This is the path I’m still walking down, months after leaving that lead developer job to start my own consulting business, and it’s humbling and awe-inspiring all at once.

Part of the issue there is that it can be difficult to find help– as the commenters to that post point out, engineers with this skillset are in-demand among the already in-demand Rails space. Talks on the issue are still rare. I wrote about my love of Chef recently, which includes some exhortations of responsibility on the part of developers, but– let’s get serious– very few are listening to me right now. That’s OK, I’m working on it.

At the end of the day, these issues matter. Knowing what to expect from your operating system, your VM’s, and your architecture is crucial to acceptable response times and uptime when you start getting the traffic that will make your business a success. Shouldn’t our entire community be more interested in ensuring that our applications have an upside? There is no silver bullet for this problem, not even hosting with Engine Yard or Heroku. Shouldn’t we have it as our mission to ensure whoever owns http://canrailsscale.com/ lets it expire?