Very Large Test Report Databases

Question

question

amichaels asked May 19, '14 amichaels commented Aug 27, '14

Very Large Test Report Databases

Hi, we're in a situation where we have >10GiB worth of test report data per 48 hour period. Aside from increasing the size of the MySQL database, what are some options for this scale of data storage? We are looking at having itestcli output the reports as HTML and put them on a fileserver for later access. Is anyone using other DBs like Oracle?

iTest iTest Enterprise test reports

10 |950

Attachments: Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Answer 1 · 2014-08-27T15:15:29Z

drakesh answered Aug 27, '14 amichaels commented Aug 27, '14

I believe we can check the size of iTest external database from "reportitem.ibd" file. ![![alt text][1]][1] We can free up the size occupied by database file with a command "OPTIMIZE TABLE " from command line. Eg: OPTIMIZE TABLE reportitem Before doing the optimize check the size of reportitem.ibd file.And then go to mysql command line, enter the reports db, run "optimize table reportitem". Ex: mysql> optimize table reportitems; After execution check the size of reportitem.ibd. it should be decrease.We could find the utilization of The "OTIMIZE" command in below links http://dev.mysql.com/doc/refman/5.6/en/optimize-table.html http://dev.mysql.com/doc/refman/5.6/en/innodb-multiple-tablespaces.html [1]: /storage/temp/4620-reportitem.ibd.jpg

reportitem.ibd.jpg (43.7 KiB)

1

10 |950

Attachments: Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

amichaels ♦ commented · Aug 27, 2014 at 03:18 PM

Thanks for the response! I'm not looking for how to assess the size of the DB, I'm looking for others' experience managing large volumes of data. With this particular database, we're now seeing an average of over 100GiB in a 5-day retention period.

0 ·

question