Monthly Archives: July 2013

//July

The Three “V”s of Big Data

Big Data. What's the big deal, really? Data has been around for a long time, and organizations have been using it to their advantage since for ever. So what is so different now? Legitimate questions from anyone who is sick of hearing all the hype around Big Data. Granted, you will come across many instances [...]

By | July 31st, 2013|Categories: Big Data, BigSQL, Hadoop|Tags: |Comments Off on The Three “V”s of Big Data

Simple CSV dumps from your Postgres database

Recently, I’ve spent a lot of time doing data shuffling.  Some of it for me and my own ( mostly ) malevolent purposes, but mostly, the kind of stuff that data analysts want to slice and dice.  I typically prefer to push analysts to the web based reporting setup I’ve built them, but a lot [...]

By | July 29th, 2013|Categories: Scott PostgreSQL|Comments Off on Simple CSV dumps from your Postgres database

Writable Foreign Tables (with transactions!!!)

One of the great features coming in PostgreSQL 9.3 is writable foreign tables. Before 9.3, foreign tables were strictly read-only, which is still very cool, but it really just made PostgreSQL a tool for query federation. Starting in 9.3, you can now execute inserts, updates and deletes in addition to selects, if the foreign data [...]

By | July 29th, 2013|Categories: Jim PostgreSQL|Tags: , |Comments Off on Writable Foreign Tables (with transactions!!!)

Fluming your PostgreSQL logs

With a default configuration of PostgreSQL, the information in the PostgreSQL logs is generally pretty small with some warnings and the occasional typo in psql. However, once you start tweaking the configuration parameters a bit and you start logging more things like query times, the logs get a lot bigger. Having PostgreSQL generate over 10GB [...]

By | July 18th, 2013|Categories: Jim PostgreSQL|Tags: , , , , |Comments Off on Fluming your PostgreSQL logs

HDFS for PostgreSQL Backups

On several occasions, I've been talking with groups of PostgreSQL users and the question comes up, "If I use PostgreSQL, why would I want to use Hadoop?" There are many answers and the question is usually asked when people don't really understand the details about Hadoop, but let's just focus on a single use case. [...]

By | July 11th, 2013|Categories: Jim PostgreSQL|Tags: , , , |Comments Off on HDFS for PostgreSQL Backups

Hadoop Sqoop Tutorial HDFS Hive & Postgres

The Hadoop Sqoop Tutorial is the third in the series providing easy to follow examples of using a Hadoop cluster in conjunction with Postgres.  This tutorial will build on the Hadoop Hive Tutorial which should be considered a pre requisite if you want to run the examples provided. In this tutorial, we will create a Postgres table from public domain [...]

By | July 10th, 2013|Categories: Big Data, BigSQL, Hadoop, OpenSCG, OpenSource, PostgreSQL|Comments Off on Hadoop Sqoop Tutorial HDFS Hive & Postgres

BI and Hadoop

The Data Warehousing Institute anticipates that Hadoop technologies will soon become a common and valuable complement to established products and practices for BI (http://tdwi.org/research/2013/04/tdwi-best-practices-report-integrating-hadoop-into-business-intelligence-and-data-warehousing.aspx). Increasingly, data conscious businesses are putting their BI groups under pressure for all sorts of data and analytics. Where, some time back, a weekly report summarizing a few select KPIs was [...]

By | July 10th, 2013|Categories: Big Data, BigSQL, Hadoop|Tags: |Comments Off on BI and Hadoop

Postgres – Hadoop Data Trends

Every so often I like to take a look at trending data to get a feel for technology trends and attempt to draw some insights moving forward.  Recently with the overwhelming hype around BigData and Hadoop, I decided to take a closer look at the relative search traffic between Postgres and Hadoop. Using Google Trends [...]

By | July 5th, 2013|Categories: Big Data, OpenSCG, PostgreSQL, thoughts, Uncategorized|Comments Off on Postgres – Hadoop Data Trends

Getting to Know PostgreSQL

At our last Philly PUG meeting, I saw something really cool. For over 75% of the attendees, it was their first PUG meeting. After the meeting, when we had a chance to talk, I found out why. They were pretty new to PostgreSQL and the topic was something that wasn't intimating. When I asked further [...]

By | July 3rd, 2013|Categories: Jim PostgreSQL|Tags: , |Comments Off on Getting to Know PostgreSQL

Announcing pgHA version 9.2-1.00.20

pgHA provides automated failure detection and switchover of a PostgreSQL streaming replica pair.  Version  9.2-1.00.20 has been updated to include a more intuitive control script as well as native nagios-compliant output for integration into your monitoring system. Download pgHA.

By | July 1st, 2013|Categories: Scott PostgreSQL|Comments Off on Announcing pgHA version 9.2-1.00.20