Comments on: Using Facebook’s Thrift with Python and HBase

By: Adam

Adam — Fri, 25 Dec 2009 19:28:12 +0000

Hey, Great tutorial – Thanks!.

It didnt work out of the box for me however with latest HBase (0.20.2) and thrift (0.2.0-incubator).
It seems that either the thrift auto-generated code or Hbase thrift API changed somewhat.

in particular, one should use kwargs parameter style when creating ColumnDescriptor:

Instead of this:
desc = ColumnDescriptor( { ‘name’ : ‘foo:’ } )
Use this:
desc = ColumnDescriptor(name=’foo’)

Adam

By: Tim

Tim — Fri, 13 Mar 2009 10:59:23 +0000

@Goran: There’s also Dumbo which lets you do map/reduce on hadoop in python. Though it uses hadoop streaming, not thrift.

http://wiki.github.com/klbostee/dumbo

By: Yann

Yann — Tue, 23 Dec 2008 18:46:20 +0000

Not yet but will try it soon!

By: Goran Cetusic

Goran Cetusic — Wed, 17 Dec 2008 11:39:26 +0000

Great post, any luck in using thrift to get a HDFS API??

http://wiki.apache.org/hadoop/HDFS-APIs

By: Marek Kubica

Marek Kubica — Mon, 25 Aug 2008 12:16:49 +0000

Update: It was a problem with GCC 4.3, see the Thrift FAQ. I could get the Thrift SVN version from the Apache Incubator to run.

By: Marek Kubica

Marek Kubica — Sun, 24 Aug 2008 09:07:38 +0000

I just tried building Thrift 20080411p1 on Debian Lenny (installed libboost) but after spitting out many warnings make fails finally with:

src/main.cc:1114: error: ‘PATH_MAX’ was not declared in this scope
src/main.cc:1115: error: ‘rp’ was not declared in this scope
src/main.cc:1118: error: ‘rp’ was not declared in this scope

I wonder how you managed to build it.

By: Paolo

Paolo — Tue, 05 Aug 2008 09:21:19 +0000

Thank you very much for this tutorial!

By: Rich

Rich — Sun, 20 Jul 2008 13:22:27 +0000

You’re a champ.
I’ve been itching to try out HBase since I wrote something about the AppEngine Datastore API that illicited the kind of comments that made me think that either I’m missing something, or other people are.

Hbase is a BigTable copy, but I’m flabbergasted at how simple the GAE Datastore API makes BigTable. Sure, they control the deployment environment, but there’s more lessons in that than I can begin to understand.

Thanks very much for taking the time with this.
Cheers
-Rich