Using transformers to modify data.
Recently active
Hi im trying to find out if its possible to apply a photoshop curve to a large raster data set. the file format of the curve is .acv, which cant be read into FME. I Was wondering if it were possible to convert it into something that can be read in. regards
Good Day,Still learning and I need help on this. THANKS A LOT IN ADVANCEHAVE THIS DMDLOCD6_1_2020D1_13_20D1_20_2012039GDL0.1980.2010.28412039MEX1.1811.2011.6912039MTY0.8950.911.28112039TIJ1.2761.2390.297 First Row is HeadersNEED THIS 12039GDLD6_1_20200.19812039GDLD1_13_200.20112039GDLD1_20_200.28412039MEXD6_1_20201.18112039MEXD1_13_201.20112039MEXD1_20_201.6912039MTYD6_1_20200.89512039MTYD1_13_200.9112039MTYD1_20_201.28112039TIJD6_1_20201.27612039TIJD1_13_201.23912039TIJD1_20_200.297
Hi, I have different DXF/DWG file and want to calculate the BoundingBox of the geometries for every file.The BoundingBox should be a seperate layer in the output file.What is the best way to solve my problem? Thanks and best regards
I think I have the easiest question ever but I've wasted too much time on it and it just won't work.I just want to create a new attribute for each record with the result of the sum of 3 other values. The result of nieuw + renovatie + stroomopwaarts. It looks very easy but i have already tried everything and nothing works. What am I missing?
Hi, How can I take a point that has overlaps at a distance of 150 ft from the pointonpointoverlayer and take those overlapping points to form a circle? I used the https://knowledge.safe.com/questions/25031/offset-points-on-a-circle.html reference and I was able to build a circle from eriks but I go from 798 records to over 10,000.
Not really a question but a warning...Reading data directly from inside a ZIP file is great, but there are a few issues that can catch you out. Firstly, you need enough space in the FME_TEMP folder to extract the entire contents of the ZIP file, which can be annoying if you only want one file. Read and vote for my idea on this here:https://knowledge.safe.com/idea/100199/reading-from-zip-files-extract-only-file-specified.htmlSecondly, I've discovered that if you read data from inside a ZIP file using the File and Pathnames Reader, the metadata about the files will be based on the extracted data in FME_TEMP, not the original ZIP file location or properties of the files inside (such as the date created). So in the screenshot below, the path is the FME_TEMP folder, not the original source folder. And the created, modified and accessed dates are all today, because that's when I ran the Workspace and therefore when the data was extracted from the ZIP to the FME_TEMP folder.
I've attached my xml and xfMap file. I read 'Consectetur' and 'Purus' as featuretypes. I want to add the attributes from 'Lorem' (version) and 'Ipsum' (date) to my featuretypes. Is this possible with xfMap? I already tried some things with references but had no result.Another problem I encounter is that I cannot read geometry by using 'Location' in my Feature Content Map. I don't know what I'm doing wrong. I've used the geometry part from the TOP10NL Reader.
Hi all,I am currently loading data into a SQL Server database from geodatabases. When I load in the data in via arccatalog, i successfully see the data. Now when I do this via FME, i seem to get a different icon and then the spatial index has to be recalculated. The data is visible but this icon appears at every point. Does this mean the spatial index has not been created? Is there a easy automated way, where the spatial index gets created when loading into a enterprise geodatabase SQL server?
HI, I have a dwg file with a lot of layers which can be seen in Civil 3D: Not every Layer have a block entitiy in it yetI am trying to rename layername in FME, but I am 1. Very unsure on how to set up my reader, since there are many options and parameters to choose form when reading a dwg file, I can choose to open per Layername or geometry etc, this is the settings I have now which just shows up as "<All>" and chose Autocad dwg/dwf as reader I DO NOT whant to change specific entities layername, which is the setting now, the problem is that some layers do not have entities so only the number of entities are read and I can choose "autocad_layer" and see that value but only for 3 layers. I want to read in ALL layernames, and use a attributemanager and say if layername="T-KST" rename to "Roads" for example and be able to do that for all my layer names (and possible the description of the layer) which can be seen to the right in the first ima
I am new to FME. I think this is a simple quetion for you guys. I have a SQL table with two fields Longitude and Latitude and other attributes in SQL Server database. I need to it to Feature class into same database. how to do that? how to setup Longitude and Latitude fields as geometry fields in the reader?
I have a polyline where each point has its own heightfor these polylines I need to recreate the geometry (a pipe is round with a diameter of attributes, a pipe is rectangular with different ratios of width and height from attributes)but difficulties appearedthe pipe has fillets at the endand pipes of square section are either built on a plane or along non-joined segmentsFriends I ask for help on how to build a solid geometry, taking into account different heights, and make the end of the pipe flat
Part of my FMW gets an area, creates a grid of points within, converts them to blocks via the dwg styler and then clips it from a negative buffer of itself. This is an attempt to create a symbolic fill for an area.Blocks still expand beyond the Area as seen below (1st screenshot is the current result, 2nd screenshot is desired output). Is there a way to clip the blocks to the area? I would also like to randomise the fill pattern rather than use a strict grid, so if anyone has an idea on how to do this I would be very interested.
Hello, everyone. I have points (attributes: X, Y, ID) and I want to merge points that are under 50 m distance and new point should have attributes ( new_ID, X, Y, all id of the points from which the new point was created) and if there is a duplicate point, also making one with attributes ( new_ID, X, Y, all id of the points from which the new point was created) Thanks a lot.
Hi there, I have Incident_no in the csv which I don't want to include into the calculation. Data is coming from the database. Is there any way that I exclude the records that contain incident number present in CSV? I tried with Feature joiner but it didn't give an option of not equal.
Using the logic from this post and this post, I wanted to rename my log file using the Pyhton shutdown script.For some reason, os.rename works only with python 2.7 and not python 3.x.I tried single, double, and triple quotes; used raw, and I can't seem to find a good way to correct os.rename. Used FME_macro and just a string for the source file. Nothing worked so far.# Import modulesimport fme, datetime, time, os# Get current date and timedateToday = datetime.date.today().strftime('%Y/%m/%d')timeNow = datetime.datetime.now().time().strftime('%H.%M.%S')logger = open(FME_LogFileName,'a')logger.write('Date: {}\n'.format(dateToday))logger.write('Time: {}\n'.format(timeNow))logger.write('ProcessID: {}\n'.format(fme.processID))logger.write('Status: {}\n'.format(fme.status))logger.write('Workspace duration was {} seconds\n'.format(fme.elapsedRunTime))logger.write('Total feature read {}\n'.format(fme.totalFeaturesRead))logger.write('Total features written {}\n'.format(fme.totalFeaturesWritten)
The output feature class based on the sample data should have 3 features (one per file) and 50 columns named and populated from all lines which include the symbol “=”, e.g line 7: LIDAR POINT COUNT=35,391,512, where the ColumnName is "LIDAR POINT COUNT" and the Value is "35,391,512".The polygon should be created using the UPPER LEFT X, UPPER LEFT Y, LOWER RIGHT X and LOWER RIGHT Y.The number of features will vary from file to file; another file might result in 312 features.I have managed to extract the desired rows and aggregate them into the requisite 3 features (see attached 2017 fmw), but am now stuck as to how to pull the attributes back apart and build the polygons...
I have an attribute string such as 6-6.35@4T. Where the 6 before the "-" is size (which can be a two digits such as 12). The characters between the "-" and the "@" are a depth measurement (and could also be something like 20.50). The number after the "@" is a clock position and can be in the range between 1-12. The alpha character at the end is indicative of a type. We captured the characters before the "-" as a size attribute. We did this using the string function - @Left(@Value(In_A),(@FindString(@Value(In_A),"-"))).What is stumping us is how to capture all characters between the "-" and "@" as a depth attribute and the numbers after the "@" as a clock position?We would like to accomplish this in the attribute manager if possible.Any help is much appreciated.
Hi, I am trying to make use of some code in the PythonCaller to work out the number of working days. I found this code that had been posted. import fmeimport fmeobjectsfrom datetime import timedeltafrom datetime import datetime(MON, TUE, WED, THU, FRI, SAT, SUN) = range(7)weekends=(SAT,SUN)def networkdays(start_date, end_date, holidays=[]): delta_days = (end_date - start_date).days + 1 full_weeks, extra_days = divmod(delta_days, 7) # num_workdays = how many days/week you work * total # of weeks num_workdays = (full_weeks + 1) * (7 - len(weekends)) # subtract out any working days that fall in the 'shortened week' for d in range(1, 8 - extra_days): if (end_date + timedelta(d)).weekday() not in weekends: num_workdays -= 1 # skip holidays that fall on weekends holidays = [x for x in holidays if x.weekday() not in weekends] # subtract out any holidays for d in holidays: if start_date <= d <= end_date: num_workdays -= 1 return num_workdaysdef processFeature(feature): start_date = date
Just upgraded to 2019.0.2.0 and the BulkAttributeRenamer shows some unexpected behaviour, when an attribute's name contains special characters (in my case German umlauts "äöü", but I assume any non-ascii trigger the problem). Problem did NOT occur in 2017.1.2.The transformer's mode of operation (prefix, regex etc.) doesn't seem to matter: simply adding a prefix is enough to trigger the bug.Minimal example to reproduce:Create a feature with an attribute name, e.g. "ÄTTRIBUTE" = 1Add a prefix to it with BulkAttributeRenamer, e.g. "FOO_"Note you now have "FOO_ÄTTRIBUTE" as expected, but with an empty value (instead of =1) AND you still have "ÄTTRIBUTE" carrying the original value (only visible when inspecting all of the feature's attributes, i.e. click the row in inspector)Can anyone else reproduce this?
Hi,I have a lot of workspaces for FME 2018.1 that use PythonCaller and PythonCreator and log messages to both the translation log window, and the log file, with the logMessageString function, like this:def log(message, severity=FME_INFO): fmeobjects.FMELogFile().logMessageString(str(message)), severity) After upgrading to FME Desktop 2019.2.2, I noticed that FME will neither log to the translation window, nor write anything in the log file, when using logMessageString, or Python's own print function for that matter. I've tried both FME Python 2.7 (deprecated) and FME Python 3.7+. I have this workspace: My PythonCallers (print function included just for additional testing): Running the workspace produces this translation log: Command-line to run this workspace: "C:\Program Files\FME Desktop 2019.2.2 x64\fme.exe" C:\FMEDataTemp\FME2019-Python-logger.fmw Starting translation...2020-01-13 11:35:41| 1.0| 1.0|STATS |Storing feature(s) to FME feature store file `C:\TEMP\wb-
We've just upgraded an FME server from 2018.1 to 2019. When running any of the workbenches that have the python interpreter set to "ESRI ArcGIS Desktop (Python 2.7)" the FME engine mysteriously crashes and restarts the job when it hits the python code. I cannot find any reason for this. If I switch it to the Python 3.7 interpreter the workspace fails with a python error, which I'd expect because its the wrong python version, but at least the server engine doesn't restart itself. Has anyone seen this behaviour and any idea what could be causing it? Using 64-bit FME, 64-bit python and 64-bit ArcGIS.
Hi there, We have a a problem reading a WFS with FME Workbench 2019.0. (ArcGIS Pro). We're using two datasets, If we check the data in ArcGIS Pro both datasets have overlap and the same coordinate system: When we read the same data in FME using the default coordinate reference system, we see the following: According to the translation log the following happened:FME Configuration: Using ESRI Reprojection Engine CS-MAP Reprojector: Transformation will be automatically selected for 'LL84' -> 'EPSG:23031', and is not guaranteed to remain the same in future releases of FME Reprojector: Using transformation `ERP50-W_to_WGS84,Inverse(Multiple Regression)' when reprojecting from LL84 to EPSG:23031 We tried to use the Reprojector and the EsriReprojector to change the coordinate reference system without success. Also changing the coordinate reference system in the reader itself was not successful. Help or advice would be highly appreciated.
Hello, I am dealing with XML files that contain more than 300 attributes deeply nested within lists, and the records present point data. The final goal is to extract and flatten all the data that is there and covert it further into a gdb. What I was doing so far was flatten the XML through the XML reader, and then use Attribute Exposer to expose as many lists and list elements as possible. However this is quite time consuming since every element contains lists that need to get exposed, and does not create a unique solution for all the XMLs that I have. Moreover, the extent is different in every XML, for example I choose to expose certain elements based on a reference XML file: Content.Base.Relationshiplist.Relationship.Referencelist.Reference{0}.ReferenceID Content.Base.Relationshiplist.Relationship.Referencelist.Reference{0}.ReferenceID.type Content.Base.Relationshiplist.Relationship.Referencelist.Reference{0}.ReferenceID.primary Content.Base.Relationshiplist.Relationship.Referenceli
Hi there! I am working on a specific analysis. This analysis needs to calculate 13 000 ha of parcels (area) randomly and then assign a new attribute value to this. Right now I have the following workflow:I thought I could make this work by calculating the percentage and then use the Sampler to randomly select parcels, but this doesn't work because the sum of ha does not add up. What I am looking for is a tool that allows me to use the following formula:"Random amount of parcels added up" = 13 000 haSo I guess it is a randomized sampler using a certain value based on attribute values. Does anyone have any idea how to do this? Thank you so much in advance!
Hi there, I'd like to find out if there is a way to generate a sample of my data based on a measurement instead of a count?The Sampler transformer seems to do the calculations based on counts of features, but what I need is, for example, say I have 1000 kilometers of road geometry, and I want a random sample of 50 km.Is this possible? Thanks in advance,