Solved

Can the Translation Log output be using in a workbench as attributes?


Badge

Hi all,

 

I'm using the AmazonAthenaConnector to query an Athena database.

In the Translation Log I'm seeing:

 

"2023-03-10 09:04:27| 6.1| 0.0|INFORM|AmazonAthenaConnector: Query ran successfully. Run time: 5.225 seconds. Data scanned: 27694.09 kB"

 

I'd like to use the info on the file size / Data scanned to do some cost calculation.

 

1: Is there a way to incorporate the output of the Translation Log as attributes in the workbench?

 

Alternatively I guess I could load the .log file in a workbench and use that for the calculations...

2: I am wondering , can I run the main translation AND the .log file in the same workbench? (wait for the main translation to have finished so it can read in the log file and perform operations on that.)

 

 

 

icon

Best answer by nielsgerrits 10 March 2023, 09:33

View original

3 replies

Userlevel 6
Badge +31

You are probably looking for the LogMessageStreamer?

Badge

That's what I was looking for.

 

Dank je Niels!

Userlevel 6
Badge +31

That's what I was looking for.

 

Dank je Niels!

Graag gedaan :)

Reply