Author Archives: datathinker

About datathinker

a technical consultant on Database performance optimization, Database storage expansion, Off-database computation. personal blog at: datakeywrod, website: raqsoft

Examples of Non-database Sources in Report Building

  Besides databases, local files, HDFS files ,NoSQL databases and JSON data streams are also frequently used data sources in building reports. These types of data sources are not as good as databases in terms of computational abilities. Since they … Continue reading

Posted in Uncategorized | Leave a comment

Collection of Solutions to Knotty Report Building Problems

There are many knotty problems around report development. These include complex layout, which is difficult to build with a reporting tool alone; complex data sources requiring dynamic access and involving different types of databases or non-database data; as well as … Continue reading

Posted in Report | Leave a comment

The Three Stages in Building Reports with Heterogeneous Data Sources

There are many different types of report data sources, including relational databases, NoSQL databases, local files, HDFS files and JSON data stream. It’s easy to build a report with a single data source, but it’s difficult to build one that … Continue reading

Posted in Report | Leave a comment

esProc Assists BIRT in Handling Irregular Month Grouping

Problem source: http://developer.actuate.com/community/forum/index.php?/topic/36323-months-and-quarters-group-issue/ Irregular month grouping: If the start date is 2014-01-10, group dates from this date to 2014-02-09 together and dates from 2014-02-10 to 2014-03-9 together. If the start date is 2014-01-31, put dates from this date to 2014-02-27 into … Continue reading

Posted in Report | Tagged , , , | Leave a comment

Calculate Growth Rate in Jasper Crosstabs

Problem source: http://community.jaspersoft.com/questions/847490/how-get-annual-growth-rate-crosstab . As every column in a crosstab is generated dynamically, you also need to reference them dynamically when performing inter-row calculations. There is some difficulty in handling this dynamic reference using a Jasper script. But the data … Continue reading

Posted in Report | Tagged , , | Leave a comment

esProc Joins a Structured Text file with a JSON File

structure.txt is a tab-separated structured text file. json.txt contains non-structured JSON strings. We need to join the two files to create a new file result.txt. The original data is as follows: structure.txt Json.txt Result.txt esProc will first import json.txt as … Continue reading

Posted in Structured Text, Text Processing | Tagged , , | Leave a comment

Find Differences between Text Files with esProc

Problem source:http://bbs.csdn.net/topics/360033579 Compare the following two text files of the same format and write the differences (different records) into a text file. Content of 1.txt: Proto      Local Address Foreign Address     State TCP 111.11.1.111:1975   221.181.70.12:5926       ESTABLISHED Content of 2.txt: Proto      Local … Continue reading

Posted in Text Processing | Tagged , , | Leave a comment