DadosGov at SERPRO

Technologies , , , ,
Roles , ,
Period , , ,

After approximately 6 months working at SERPRO, I was transferred to an area that had an urgent demand of strategic interest from the Presidency of the Republic of Brazil.

The problem at the time was the balance of accounts of President Lula’s government, which at that time was ending his second term.

At that time, several reports on results achieved in public policies were processed through an internal BI platform called Netuno BI.

Netuno BI was a tool with many limitations and required a lot of manual work from analysts interested in developing dashboards using this technology.

When I was introduced to the service that should be performed, my superiors’ intention was that I joined the team that developed the dashboards using this tool. However, I quickly realized that my mission on that team would be another.

Dashboards were created with a lot of manual work, where the data analyst needed to fill in several specific fields in configuration files, which informed the name of the columns, the number of decimal places, among many other attributes that were filled in manually and that exposed the process to many human failings.

It was quickly possible to realize that the process was not functional, and that it would not be possible to meet the requested deadline by maintaining the same process. On that occasion I had to make a very challenging decision. I decided to propose a completely new process, where all these programming files were automatically generated through programming, consulting a few dozen metadata available in the database.

I already had a previous experience at UFJF with code generator programs that had already been successful. I decided to call this program Autômato, and at the end of the day it generated a ZIP package with several files that were recognized by Netuno BI. With this automation, it was possible to reduce a 4h workload to just a few seconds.

With the previous process, it was possible to publish only a few historical data series per day. After the implementation of this automaton it was possible to publish hundreds of them in the same day. In addition to this improvement, I also proposed a serial production, in which only at the end of the day all files were transferred to the server, instead of sending one by one as was done before.

With all these improvements, it was possible to publish the almost 2,000 historical series that were part of the 6 books registered in the notary’s office that contained vital information on the Balance of the Eight Years of President Lula’s Government. As a result of this work, I was invited to the Government Balance Ceremony, which was held at the Planalto Palace in Brasília, in the presence of the President of the Republic.

Presence of the team at the Balance Ceremony of the 8 years of the Lula Government where the DadosGov System was presented by the President of the Republic on 12/15/2010 (personal file)
The last version of DadosGov that was rebranded to PGI