Skip to main content
Solved

Can the Translation Log output be using in a workbench as attributes?


Forum|alt.badge.img

Hi all,

 

I'm using the AmazonAthenaConnector to query an Athena database.

In the Translation Log I'm seeing:

 

"2023-03-10 09:04:27| 6.1| 0.0|INFORM|AmazonAthenaConnector: Query ran successfully. Run time: 5.225 seconds. Data scanned: 27694.09 kB"

 

I'd like to use the info on the file size / Data scanned to do some cost calculation.

 

1: Is there a way to incorporate the output of the Translation Log as attributes in the workbench?

 

Alternatively I guess I could load the .log file in a workbench and use that for the calculations...

2: I am wondering , can I run the main translation AND the .log file in the same workbench? (wait for the main translation to have finished so it can read in the log file and perform operations on that.)

 

 

 

Best answer by nielsgerrits

You are probably looking for the LogMessageStreamer?

View original
Did this help you find an answer to your question?

3 replies

nielsgerrits
VIP
Forum|alt.badge.img+54
  • Best Answer
  • March 10, 2023

You are probably looking for the LogMessageStreamer?


Forum|alt.badge.img
  • Author
  • March 10, 2023

That's what I was looking for.

 

Dank je Niels!


nielsgerrits
VIP
Forum|alt.badge.img+54
edhere wrote:

That's what I was looking for.

 

Dank je Niels!

Graag gedaan :)


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings