I have a workspace producing various outputs, I'd like to produce a further output which details the number of distinct customers and number of distinct products for each output but this appears to be either convoluted involving multiple steps and statistics calculators or slow involving a count distinct in the inlinequerier. Wondering if I'm missing a trick
Solved
Most efficient way to count multiple distinct values
This post is closed to further activity.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.
It may be an old question, an answered question, an implemented idea, or a notification-only post.
Please check post dates before relying on any information in a question or answer.
For follow-up or related questions, please post a new question or idea.
If there is a genuine update to be made, please contact us and request that the post is reopened.
+15- Contributor
- 2252 replies
You can use listbuilder followed by a , listhistogrammer
GroupBy the Attribute you want to have distinct element counted for.
+44- Influencer
- 3430 replies
I don't think that will work, the two things are independent.
e.g. in the following I would want the customer value to be 2 and the product value to be 3
+7Hi @egomm,
When I am in this situation I make use of a PythonCaller in order to create statistics. If you would need some help with that, just let me know!
+18- Supporter
- 1442 replies
This custom transformer should do the trick.
- 7843 replies
I also think that Python scripting would be an efficient solution, but if the destination dataset is a database, SQL querying might also be worth to try.
+15- Contributor
- 2252 replies
@egomm
Your example can easily be solved by..
Matcher followed by a statisticscalculator grouped by fme_feature_type...
Put in a custom for ease of use...
When using custom explode the features so you can use attr_name as input
No need for python or whatever.
And if its in a database then of course you would use sql.
This custom transformer should do the trick.
A
1
1
1
2
3
0
0
Output should look like:
0 -> 2
1 -> 3
2 -> 1
3 -> 1
- 7843 replies
I am trying to use this transformer to count all the unique values in a column. but does seem to work. need some help. My data as below.
A
1
1
1
2
3
0
0
Output should look like:
0 -> 2
1 -> 3
2 -> 1
3 -> 1
- Group By: A
- Attributes to Analyze: A
- Total Count Attribute: <an attribute name which will store desired count value>
Hi @sobanmughal, The AttributeValueCounter counts the number of distinct values for each attribute, I don't think it's suitable to your requirement. You can just use the StatisticsCalculator here. Set these parameters and check the resulting features output from the Summary port.
- Group By: A
- Attributes to Analyze: A
- Total Count Attribute: <an attribute name which will store desired count value>
UniqueValueLogger
https://hub.safe.com/transformers/uniquevaluelogger