A Sidebar on the IoT: Using new Things smartly

This is a sidebar to some thinking on an architecture for the Internet of Things here… - Rob I was recently prompted to think about a Big Data problem that is in the US papers… the issues around processing US Veterans through the Veteran’s Administration (VA) bureaucracy. I imagine that there are really two problems… I…

The Greenplum ORCA Optimizer

In January Greenplum rolled out a new query optimizer. This is very cool and very advanced stuff. Query optimization is a search problem… in a perfect world you would search through the space of all possible plans for any query and choose the least expensive plan. But the time required to iterate through all possible…

Memory Trends and HANA

If the Gartner estimates here are correct… then DRAM prices will fall 50% per year per year over the next several years… and then in 2015 non-volatile RAM (see the related articles below) will become generally available. It has been suggested that memory prices will fall slower than data warehouses will grow (see here). That does not seem to…

Some Unaudited HANA Performance Numbers

The following performance numbers are being reported publicly for HANA: HANA scans data at 3MB/msec/core On a high-end 80-core server this translates to 240GB/sec per node HANA inserts rows at 1.5M records/sec/core Or 120M records/sec per node… Aggregates 12M records/sec/core Or 960M records per node… These numbers seem reasonable: A 100X improvement over disk-based scan…