knime quick explanation #1 lance norskog june 25, 2010

KNIME Quick explanation #1

Lance Norskog

June 25, 2010

Makes pdf/html

• Simple PDF&HTML generator for tables

Konstantz Information MinerKNIME

• http://www.knime.org/

• Open source project with backing company– KNIME

• Business seems to be drug chemistry assay software

Query Plot

• Sample data CSV file

• Header with field names

• Query text + response time– query,time

– apple,1

– apple,2

– pear,3

Query Plot Project

• Two nodes in a KNIME project– File Reader node loads CSV file– Creates table with field names– Scatter Plot node creates the chart

Query Plot Display

• Add separate color for each query value

Cross-correlate benchmark

• Task: Join 2 tables– Query time table– Query Result Cache size table– One common timestamp (first one)

Cross-correlate benchmark

• KNIME visual node program– Read 2 files– Join on timestamp– Do scatter matrix plot

Cross-correlate benchmark

• Three fields: timestamp, query time, cache size• Yeah, I know – it does make SVG files

Pipe-fitting

• Knime works hard to be easy to use

• Has lots of metadata for the table connectors

• Still needs some pipe-fitting nodes

• The previous node program is not the real one!– I stripped something out for clarity

Pipe-fitting

• The real one also has RowID nodes• Table metadata includes unique id for each row• Join works against RowID, not data column• RowID processor nodes move timestamp into and out of row id

values

Pipe-fitting

• Interactive Table?– Need this to view output of last RowID

– This should be the default “view” for all non-display nodes

Base code

• Based on Eclipse app toolkit

• Can run workflows from command line

• File output– PDF– Csv– Svg– html

Now you know as much as me

• Only after this class do I know what the various tools do

• And it’s time to learn more

Lance Norskog

norskhaus@gmail.com