Archive for Life category

Happy 10 Years Hadoop

Ten Years of Hadoop, Apache Nifi and Being Alone in a Crowd

Hadoop Summit in San Jose this year celebrated Hadoop’s 10th birthday. All of the folks on stage are people who contributed to Hadoop during those 10 years. One of them is Yolanda Davis.

Yolanda and I worked together on a Hortonworks project last year. She was in charge of the user interface design and development team. I caught up with her early in the morning of the last day of Hadoop Summit, and quizzed her on this new project she’s working on that you may have heard of, Apache Nifi. As promised, here is my interview with her on the subject of Nifi and the new HDF (Hortonworks Data Flow) streaming data processing platform, which includes Nifi, Apache Kafka and Apache Storm.

Read more...
Holden Karau's audience at High Performance Spark preso at Data Day Texas

Interviews with Brilliant People on Hadoop and the Future of Big Data Tech

I have been doing some very cool interviews with brilliant people, usually at events like Strata + Hadoop World and Hadoop Summit. The intention is to use their brilliant thoughts so that I don’t have to take the extra time to come up with my own. Not to mention I get the bonus of learning new things, and getting the unique perspectives of folks who really know their stuff. Nothing like learning tech from the folks who literally wrote the book on it.

Read more...
Herbert the Syncsort Big Data mascot on a cup

Coffee Cups, Women in Tech, and Rampant Competence

2016 marks my nineteenth year in the field of data wrangling. Yee haw. (I’m from Texas. I can say that.) January also marks my first year, my first week in fact, at my new job at Syncsort. I flew up to the company headquarters in New Jersey and spent the first week of the year getting to know the new team and the new technology. Certain things jumped out at me as good signs. It started with a coffee cup.

Read more...
David and Goliath

Pitching Stones with David

It’s a brand new year, and I’ve got a brand new job. As of today, you’re looking at the new Product Marketing Manager for Syncsort.

It’s true. After spending half a year doing a little freelance white paper work for the Bloor Group, and documenting for Hortonworks the most complex ETL process I’ve seen in nearly two decades in the business, I’ve found a new home to settle into. I got courted by some Goliaths in the data management software and hardware space, but in the end, I chose a tech savvy David, Syncsort.

Read more...
Hadoop Data Lake Balcony

Schema on Read vs Schema on Write and Why Shakespeare Hates Me

A couple of months ago, I found myself without a full time gig for the first time in decades, and I did a little freelance blogging. Being an overachiever, I wrote such a long post for Adaptive Systems Inc. that I broke it into two parts. The first part got published before I dove head first into documenting and unit testing a big Hadoop implementation. The second part got published last week.

It was interesting reading my opinions on the nature and comparative strengths of the various strategies and technologies from a few months ago. It had been long enough that I didn’t remember what I’d written. I got a kick out of comparing my perspective, now that I have some recent hands-on experience digging through Hive code, comparing query speed with ORC vs without, or with MapReduce vs Tez.

Read more...
Water jet cutting patterns in steel

Hadoop Can’t Do That

I just got back from a little executive summit conference in Dallas for Chief Data Officers. Frustratingly, I heard a lot of folks telling me what Hadoop CAN’T do. Now, I know that Hadoop can’t bring about world peace or get my husband to put the toilet seat down, but the things people keep saying it can’t do are  things that I’ve personally DONE on Hadoop clusters, so I know they’re doable.

If you asked most people if water could cut through steel, they would probably tell you it can’t. They would be wrong, too.

Read more...
Pancakes in Space

NASA, Star Trek, Pancakes and IBM Watson

I spent the weekend before last doing the NASA SpaceApps Challenge, and for the second year in a row, my team won the local competition with a combination of seemingly trivial geeky knowledge and twisted thinking. Our challenge: To boldly make pancakes where no pancakes have ever been made before. More precisely, we answered the challenge, Print Your Own Space Food. Here’s a quote from the challenge description:

Think Food Replicators, from an early sci-fi show. Investigate the benefits and feasibility of allowing astronauts to print their own food on the International Space Station or other space facility. What would it look like? What will it be made of? How will it be possible? Create a recipe for a 3D printed meal.

Read more...
Load More
10 of 11