Sqoop for data exports out of HDFS
Can SQOOP be used to push HDFS data (or hive tables) to relational database?
It makes total sense to have primary goal to facilitate large data transfer out of dbs. However, as grid is evolving around Hadoop one of the pain point that has got least attention is efficiently getting data out of HDFS. Many latency/SLA dependent apps talk to relational database and its nice to have Hadoop do all crunching and then transfer tiny to moderate amount of data to relational database for downstream apps. And what can be better than having a single tool seamlessly doing it for you? Any thoughts? Or its already there? :p
It makes total sense to have primary goal to facilitate large data transfer out of dbs. However, as grid is evolving around Hadoop one of the pain point that has got least attention is efficiently getting data out of HDFS. Many latency/SLA dependent apps talk to relational database and its nice to have Hadoop do all crunching and then transfer tiny to moderate amount of data to relational database for downstream apps. And what can be better than having a single tool seamlessly doing it for you? Any thoughts? Or its already there? :p
1
person has this question
I have this question, too!
Tell me when someone answers.
The more people who ask this question, the more it gets noticed.
The more people who ask this question, the more it gets noticed.
-
Inappropriate?It can't.... yet :) But you're not the first person to request this feature. It's at the top of my list for new features to add. I promise it'll be available "soon."
- Aaron
Loading Profile...


