Showing posts with label chariotsolutions. Show all posts
Showing posts with label chariotsolutions. Show all posts

Friday, March 19, 2010

Audio Interview: KYW NewsRadio on Social Media in the Radio News Business


On Thursday we did an interview with Steve Butler, Program and News Director of KYW News Radio, discussing the reach of Social Media in news outlets. We cover topics as diverse as Twitter and the generational divide, using social media to discover news stories and are all areas of social media right for every situation and business.

Click on the Play button below to listen to Mr. Butler's interview with Tracey Welson-Rossman.

Saturday, January 30, 2010

Why You Need NoSql in Your Toolbox

Even if you work for Oracle, you still need NoSql databases in your toolbox.

One size does not fit all for programming languages, operating systems, IDEs, shoes, bailouts, or anything else. But for a long time now, many developers have been told that relational databases are really the only choice for persistence. If you need to store some data -- any data -- shove it in a relational database. It is the safe choice, and gives us developers one less thing to worry about, right? Well actually, wrong. RDBMS' are great solutions to many problems, but there are better alternatives for others.

Quick overview of NoSql

A simple definition of a NoSql database is a schema-less database that does not support joins or ACID transactions. In a broad simplification, there are 2 types of NoSql databases:

  1. Key/value -- A "giant hash table in the sky" that stores key value pairs.

    Pros:
    * very fast
    * very scalable
    * simple model
    * many are distributed

    Cons: many data structures (objects) can't be easily modeled as key value pairs

  2. Schema-less -- Databases somewhere in-between key/value and relational including: column-based (different rows in same table can have different columns), document-based, and graph-based

    Pros:
    * Schema-less data model is richer than key/value pairs
    * eventual consistency
    * many are distributed
    * still provide excellent performance and scalability

    Cons: typically no ACID transactions or joins

  3. Relational database

    Pros:
    * rich data models
    * ACID transactions
    * joins, reductions (group by, sum), ordering
    * lots of apps already integrate with RDBMS
    * mature, commercial support easy to find

    Cons:
    * complex
    * object to relational mismatch
    * can be difficult to scale horizontally

Performance and Scalability: Less Features = More Speed/Scaling

"Constraints proceed performance"
- Joe Gregorio, Google

"Constraints proceed performance" really sums up why many of the NoSql databases can be blazingly fast -- they implement fewer features and have some significant constraints when compared to a relational database. The key is determining whether you can live with those constraints. If you can, you reap the performance and scalability benefits. But before you become enamored with the allure of more performance, here's a list of things you'll probably have to give up:
  • joins
  • group by
  • order by
  • indexes
  • ACID transactions
  • SQL as a sometimes frustrating but still powerful query language
  • easy integration with all of the other applications that support SQL
Yikes. That's a pretty hefty price should you actually need one or more of those features. However, for many applications that perform CRUD operations on data largely partitioned by user, you might not need as many as you think.

On the scalability side of the equation, many of the NoSql databases were designed to be distributed so they can scale horizontally. Relational databases are not designed to scale horizontally. If you application really needs to scale up, vertically scaling your relational database is only going to get you so far because eventually you won't be able to buy a big enough box to scale any further. At that point you have to look at sharding your data across multiple database instances, and then you lose many of the benefits of a relational database across instances such as joins, transactions, etc.

In addition to get the performance you need, you very well may need to denormalize some of your data to eliminate slow joins. Additionally, to really scale up you may need to use a distributed caching layer like memcached that requires key/value semantics, in which case you are really starting to diverge from the pure relational model. So when making the comparison, it may be more fair to compare a sharded (data partitioned into multiple databases), partially denormalized relational database using a caching layer with an alternative NoSql database.

Productivity: Object to Relational Mapping Is Not Fun (Unless You Are Weird)

Object to relational mapping is difficult to implement, difficult to reason about, and easy to get wrong. As a developer, you either have to get in the weeds and write your own queries, or rely on a ORM tool like Hibernate which is great until something doesn't work and then you have try to find out why the magic isn't working anymore.

There is a lot of effort put into solving the object to relational mapping problem, and it still hasn't be completely perfected. This is where, depending on your data, a NoSql database can provide an abstraction that maps closer to your object model than relational tables. Column-based stores like BigTable and Cassandra essentially allow different rows in the same table to have different columns. Why is that useful? There a lots of cases where data is optional or slightly different between entities. If I was creating a ratings site, I could rate different things using different criteria, but they could all be stored in the same table. I won't need a table of "things" with a join table and a table of "criteria".

On the other hand, why is that dangerous? Obviously the application could get back data it didn't expect because the schema wasn't enforced by the database. Document-based stores like CouchDB give you even more flexibility where you store entire documents that can contain anything you want. No longer are you a slave to that crusty database administrator and all of his rules, but on the other hand you could easily hang yourself with all of this new rope. What happens later when you need to run reports on this data and you don't have a group by or sum function? You can write your own map reduce functions to essentially do the same thing, but you have to do the work.

Another point to consider is that many "rapid development" web frameworks like Ruby on Rails, Grails, Django, and Lift already have substantial ORM tools baked in. If you use NoSql for your persistence you won't be able to take full advantage of those frameworks. Some of the frameworks are starting to support some NoSql databases, but since NoSql is just a general label and not a specification like SQL, support is one off. For instance, there is a Grails plugin to provide support for Google App Engine's version of JPA.

You can't have it all; you have to decide between the complex features that a relational database supports versus the constraints/benefits that a NoSql database provides. But whether you put 99% of your data in a relational database and only 1% in a NoSql store, or the other way around, both types of databases are likely to be valuable to your business. I like the interpretation of NoSql as "Not Only SQL" meaning both types of databases can and should co-exist within your organization.

Why Now?

Non relational databases have been around since ENIAC, so why are we hearing so much about them now? My opinion is that there are 2 drivers:

1. The massive scalability requirements of some websites has exposed one of the weaknesses of relational databases: scalability. Sites like Google, Amazon, Twitter, and Facebook all use NoSql databases for major components of their site.

2. A strong open source community means that there are many high-quality, production-ready NoSql databases available. There probably have been hundreds of very good, proprietary non-RDMS databases created in the last 20 years, but since they are proprietary, they have been used at one company and no one has ever heard of them. Open source has changed that, and now companies like Amazon, Google, and Facebook are contributing incredibly valuable research and software to the community. Research papers such as Amazon's Dynamo and Google's BigTable inspired many open source implementations.

This is a fairly recently phenomena. I'm not aware of any production-ready open source non-relational databases that existed 10 years ago, and if there were, there weren't many and they weren't popular. Now there are well over 15 (and probably many more, I don't claim to know the exhaustive list) production-ready open source NoSql databases. Am I going to list them all? No, because if I do I'll miss one, and I'll get a comment saying "You didn't mention XYZ database, what's wrong with you?" But I'll list the ones I'm currently looking at in no particular order:
  • Voldemort
  • Cassandra
  • Redis
  • CouchDB
  • MongoDB
  • Terrastore
Some links for more reading:

Sunday, January 24, 2010

Mobile development and your team

Throughout the next several weeks, we will be conducting interviews with speakers who will be speaking at the Emerging Technologies for the Enterprise conference (www.phillyemergingtech.com). These interviews will give you some idea of the material we will be covering.

The first interview is with Mark Spence of Transmogrify and Rick Rasansky of Yorn. Rick and Mark will be on a panel discussion in the management track discussing why it is important to pay attention to mobile development for you company.

We tackle a different issue here. Helping your development team get up and running in this newer space.

(As a note, I am trying to get better with editing. Continue to bear with me while I learn "on the job". Please note, I finally purchased a tripod for a steadier picture!)



Here are the links Mark mentions in our interview:

http://cocoawithlove.com/ (cocoa + iphone dev blog)

http://akosma.com/ (iphone dev blog)

http://github.com/facebook/three20 (three20 on github)

http://iphonedevelopment.blogspot.com/ (Jeff LaMarche's iPhone Dev blog)

http://blog.iphone-dev.org/

http://blogs.msdn.com/windowsmobile/ (WinMo dev blog)

http://www.christec.co.nz/blog (Chris Fairbairn's mobile dev blog)
From a design point of view, we like to look at these sites for inspiration:

http://tapfancy.com/

http://www.appsafari.com/

http://wirelessdesignmag.com/

Other useful sites for keeping an eye on everything mobile:

http://gizmodo.com/

http://www.eweek.com/c/s/Mobile-and-Wireless/





Wednesday, November 18, 2009

Groovy and Grails seminar - G2 and Springsource Tool Suite

Here is another interview from our Groovy and Grails seminar. Brent Baxter had been conducting some research into G2 and the Springsource Tool Suite (STS). I asked Brent how they worked together and if this was advantageous to a developer.



As you can see here, we certainly try to gather reflections from our attendees when we have them "captive" at a seminar or conference. People are beginning to run in the other direction when they see me with the Chariot video camera in my hand...

Tuesday, November 17, 2009

Wrap up from our Grails/Groovy Seminar

Last week Chariot Solutions hosted a one-day seminar around Groovy and Grails. Or Grails and Groovy if that is your preference.

Chariot has been trying to have two events a year, the larger Emerging Technologies for the Enterprise in the spring, and a smaller event in the fall. We have tried to use the fall event as a way to see how much support there is in the development community for newer technologies. We did this with Spring, Ruby, Cloud, SOA and now Groovy. We found the Groovy and Grails community to be very vocal and enthusiastic.

Over the next week, we will be posting videos from the seminar to give you a better understanding of why Chariot will be paying a little more attention to this framework and language.

Friday, October 23, 2009

SpringOne 2GX - Interview with Chris Richardson

It was great to catch up with a good friend of Chariot's, Chris Richardson. Chris's company, Cloud Foundry, was purchased by Springsource in August, right before the Springsource acquisition by VMWare. In the interview below, Chris discusses what Cloud Foundry does and where it fits into the Springsource family.

Thursday, October 22, 2009

SpringOne 2GX - More reporting, this time on Groovy and Grails

We were able to conduct a short interview with Graeme Rocher and Jeff Brown, Grails leads, at SpringOne 2GX. They review some of the new features that will be available in Grails 1.2.



And if you are looking to learn more about Grails:
http://grails.org/Developer+-+Groovy+Server+Pages

Monday, October 19, 2009

Here we are at SpringOne/2GX

The opening night festivities have kicked off this year's SpringOne and 2GX (Groovy/Grails). The keynote is happening right now and we will be giving a recap during the day tomorrow.

While we are here, we hope to also interview (video or audio) a some of the committers we know to get an update on their projects. If you have anything you would like us to ask and who you might want us to interview, please post a comment.

Our team who will be attending session over the next three days will be giving their thoughts on what they have found to be most valuable to them.

Thursday, October 15, 2009

Getting Started with Android

Today, I interviewed Andy Oswald, one of our architects. Andy is embarking on developing an Android application for the Philly ETE conference.

In this talk, he discusses the choices he made in getting started. With so much information, he shows the particular path he took which may help if you are beginning this type of work.



The site he references is actually : developer.android.com

In future weeks, we'll follow Andy's progress as he finishes the application.

Tuesday, October 13, 2009

Chariot TechCast #42 - Couch DB


Up this week we have Chariot's Eric Snyder, a consultant with a background in traditional Java/Spring as well as dynamic platforms such as Ruby/Rails and Python. Here is a quick teaser. You can download the full episode here.

Friday, October 2, 2009

The Philly Tech Startup Community

Chariot Solutions was once a start up, way back in 2002. The beginning and the first few years were a roller coaster ride. And even though, we are now at the ripe old age of 7, I like to think we continue to operate with the spirit of a start up.

Because of our background, Chariot is a supporter of the Philadelphia tech start up community. Start ups are a vital part of the region and help bring news ideas and jobs to the area. Chariot is a great example as this. We began with 10 employees and now have 50 consultants on our payroll. We also are bringing the newest technologies for application development to the region.

There are many other stories like this in Philadelphia - MyYearbook.com, Monetate, GSI Commerce, Invite Media, Half.com - and there are more in the works. Chariot is a sponsor of the Founder Factory, www.founderfactory.com, where the start up community comes together to learn from those who have been down this path, too.

Thursday, September 17, 2009

Emerging Technologies for the Enterprise 2010 Annoucement

For our 2010 edition of Emerging Tech, we are happy to be sharing some of our time with our friends from Sonatype.

At this year's conference, Jason van Zyl, approached our team about working with the Maven or Apache groups to have a joint event. It was very nice to hear that speaker who travels the conference circuit thought so highly of our event.

We thought about it, had some discussions and we decided it would be a great idea to co-locate a Maven Meetup with our show, Emerging Technologies for the Enterprise. We would get a chance to add some great speakers and topics to our show and we could help the Sonatype Maven group bring a specialized show out to the East Coast.

ETE's site is up (www.phillyemergingtech.com) and you can see some of the speakers we have been able to line up this early. We are pretty happy with who has said Yes so far. We'll keep you posted as we add more.

So, save April 7th for the Meetup and April 8 and 9th for ETE. Registration will be open mid-October

Friday, September 11, 2009

Social Media and the Technologist

Yesterday, Skip Shuda and Marilyn Moran, of Team and a Dream, stopped by our offices to discuss social media and what it means to Chariot's team members. We reviewed some of the basics, but also discussed why a person in the technical field should care.

After our meeting, they sat down for an interview with Ken Rimple. Also, note the video shot is not shaking this time. We now have a tripod!

Saturday, September 5, 2009

iPhone and SSL

One of the problems I ran into while working on our iPhone app (see past post) is handling SSL connections. It works just fine with proper certificates, but we have several machines with self-signed SSL certificates. The normal NSURLConnection in the iPhone SDK just rejects connections to a server with a self-signed certificate, and there isn't an obvious API to get around that.

A few searches turned up a way to override part of NSURLRequest or something like that, but it really seemed to be a hack -- plus it seemed to be all-or-nothing, instead of having an easy way to hook into the particulars of each request.

Long story short, I found a better way to handle this, which may be new in the 3.0 SDK. Put this in your NSURLConnection delegate (for asynchronous requests):

- (BOOL)connection:(NSURLConnection *)connection
canAuthenticateAgainstProtectionSpace:(NSURLProtectionSpace *) space {
if([[space authenticationMethod] 
isEqualToString:NSURLAuthenticationMethodServerTrust]) {
// Note: this is presently only called once per server (or URL?) until
//       you restart the app
if(shouldAllowSelfSignedCert) {
return YES; // Self-signed cert will be accepted
} else {
return NO;  // Self-signed cert will be rejected
}
// Note: it doesn't seem to matter what you return for a proper SSL cert
//       only self-signed certs
}
// If no other authentication is required, return NO for everything else
// Otherwise maybe YES for NSURLAuthenticationMethodDefault and etc.
return NO;
}



Because the delegate typically has more information about the connection, it can make a more intelligent decision in that method. For instance, our app has a config screen where you enter a server URL, username and password if needed, and a checkbox for whether to allow self-signed SSL certificates. So our code above looks up the value of that config setting for the server when the method is called with NSURLAuthenticationMethodServerTrust.

As the comment indicates, the method is only called with NSURLAuthenticationMethodServerTrust once for any given server configuration and the result apparently cached (even across brand new NSURLConnection instances). I'd be interested if there was some way to force it to reset all that and call the method again with NSURLAuthenticationMethodServerTrust.

In a future post, we'll look at how to support HTTPS client cert authentication, which also seems to have better options in the 3.0 SDK.

Friday, September 4, 2009

Dan Allen Interview at JBoss Word - Seam update

JBoss World is winding down. It has been a good few days in Chicago. We have had the chance to catch up with some old friends and meet some new ones.

Our next sit down is with Dan Allen, a good friend of Chariot's and a JBoss developer who wrote Seam In Action.



Also, check out longer interviews with Dan at Chariot TechCast:

Dan Allen on Seam, Part 1 - http://techcast.chariotsolutions.com/index.php?post_id=443923
Dan Allen on Seam, Part 2 -http://techcast.chariotsolutions.com/index.php?post_id=444317

Dan - we are very happy you found your Oakleys.

Thursday, September 3, 2009

Interview with Manik Surtani, Infinispan

Here is the next interview we conducted at JBoss World which featured Manik Surtani of Infinispan. If you watched the interview with Emmanuel, you heard that Manik's talk was one he was highly anticipating. Manik is the lead at Infinispan and also for JBoss Cache



Here are the links Manik mentions in this video:

http://www.infinispan.org
http://blog.infinispan.org

http://twitter.com/infinispan


He also asked us to include this one:
http://infinispan.blogspot.com/2009/08/podcast-on-infinispan.html

Thanks to Manik for his time.

Video Interview: Emmanuel Bernard at JBoss World

As promised, here is the first of our interviews at JBoss World. Emmanuel Bernard was our first guest. The content is great, but our camera skills need some improving!


Emmanuel Bernard, author Hibernate Search in Action


Emmanuel's blog is http://in.relation.to/Bloggers/Emmanuel if you need more information about Hibernate.  Also, we have recorded a Chariot TechCast, episode #25, if you want to hear more about Hibernate Search and JSR-303.  Click here for the podcast episode page.

Check back later as we post our interviews with Manik Surtani and Dan Allen.

Wednesday, September 2, 2009

First evening at JBoss World

We had a very nice start to our time at JBoss World last night.  There was an opening party from 6-9 in the Partner Pavilion where the attendees mingled with the exhibitors. 

We were able to interview Emanuel Bernard and Manik Surtani.  I hope to upload those later today.  If not, they will be up on the blog early next week.  We also were able to catch up with Greg Hinkle, lead of the JON team at JBoss.  Greg was a Chariot "eer" a few years back and we are always happy to see him at these events.

Check back later for an announcement from us on an application our team has created.

Saturday, August 29, 2009

Welcome

Welcome to Chariot Solutions' corporate blog.

This is an experiment for our team. As with the Chariot TechCast, we want to keep our audience informed. This blog will use more video and will also have guest bloggers. We want to have a range of topics in the open source space ranging from those that will be appreciated by the very technical to those appreciated by the management side.

Our first real post will be from JBoss World. We hope to have interviews with many of the key players from the JBoss middleware team. Check back here on Wednesday or Thursday for our first video upload.