Using transformers to modify data.
Recently active
I am trying to extract a PDF attachment from an ArcGIS Online feature layer and write it to another online program using the HTTPCaller. (I can do so with CSV attachments.) I can see the PDF is being read by FME Desktop (2020.1.2.1 - build 20624); it's in the arcgisonline_attachment{0}.data attribute but I'm not able to successfully write the PDF contents to the other program. Other forum posts indicate I should use the BinaryDecoder first but it won't decode using either option - Binary64 or HEX. I get an "Invalid Base64 character '%'" or "Invalid HEX character '%'" error. I tried using no decoder and writing the contents of the arcgisonline_attachment{0}.data attribute to the output location directly but get the following error: Received HTTP response header: 'HTTP/1.1 400 Bad Request: Invalid .pdf file.'. What do I need to get the contents of the PDF in the proper format so I can upload it?
I am automating a process of creating a Service Request on City works suing an Email (IMAP) topic and notification on FME Server. However, when email is received, my Workspace reads (JSON reader) it as an html instead of plain text and charset- utf=8; I have JSON extractors and HTTPO caller later in the Workspace and therefore due to this problem fails to create SR. I am attaching an image from the log file. Any feedback is much appreciated.
Happening in Parent just before Workspace RunnerExcerpt from log:WorkspaceRunner_2: Running FME Workspace E:\\supply\\Standard_Supply\\SQL_Server\\10km_Buffer_to_SQL_Supply/SQL_Server_County_10K_Buffer_Supply.fmw with command line:2023-07-25 16:30:02| 1.0| 0.0|INFORM|WorkspaceRunner_2: {C:/Program Files/FME2021/fme} E:/servername/Standard_Supply/SQL_Server/10km_Buffer_to_SQL__Supply/SQL_Server_County_10K_Buffer_Supply.fmw --INPUT_POLYGON E:<backslash>supply<backslash>Common_Dependencies<backslash>Esri_Shapefile<backslash>10k_Buffer_Local_Authorities<backslash>COUNTY.shp --QUARTER 2023Q3 --OUTPUT_COORD_SYS IRELAND-ITM --SQL_SERVER_BACKUP {\\<backslash><backslash>servername<backslash>e<dollar><backslash>SQLData<backslash>CountyCouncil<backslash>ITM<backslash>2023_Q3<backslash>COUNTY<backslash>2023Q3_COUNTY_ITM.bak} 16:30:05| 1.0| 0.0|WARN |WorkspaceRunner_2: Failed to run workspace E:/supply/Stand
I am trying to change the authentication from local to windows authentication in Cityworks. What changes do I need in HTTP Caller parameters? Is the chosing NTLM (username, password) under "Authentication" section enough or do I need to add something under "Header" or other parameters?
I'm trying to make a dynamic transformer that uses a feature writer to create a temporary file in some format (FFS, CSV, Parquet, doesn't matter) and I need to supply a schema line for the Feature Writer to accept the incoming features. Most readers won't supply one such line, and even though FME is keeps track of some sort of attribute type tag that AttributeMapper is now able to modify, and that AttributeValidator can check with the TYPE operator, there seems to be no way to either get the attribute type map from the features themselves (as shown when hovering the headers of the data inspector columns) or to get the attribute list from the feature type definition (as shown when inspecting a reader and checking the FEATURE_TYPE section of an FMW file). The only ways to get a schema line seem to be to use a SchemaScanner, a SchemaMapper, an AttributePivoter or a FeatureReader. SchemaScanner seems to be the reccomended option in a case like mine, although that does seem to r
Hello friendly FME Community! I'm trying to implement a GeoFencing service which will calculate the time spent by vehicles in particular areas. In short, I have a set of points (with timestamps) and set of polygons (geofences) against which I want to calculate how long these points were inside these polygons. I did make a workspace which does this using SpatialFilter (which identifies if points were inside polygons) StatisticsCalculator which calculates min and max timestamps and DateTimeCalculator which calculates the interval between this min and max timestamps. The problem is that vehicle can move out of all polygons and then get back which will distort the calculation as the period that vehicle was outside the polygon will be included because last timestamp will be inside the polygon. Is there any trick or technique in FME which allows to follow up these gaps and exclude them from calculation described above? Thank you in advance for any suggestions!
I have a few AutoCAD drawing files (.dwg) that have a number of 2D and 3D lines and polylines. My goal is to extract all the vertices of each individual line so that I can store it within my GIS database (PostgreSQL). Additionally, I want to extract the layer name and a few other attributes. Is there a way to extract this data and convert it into a Shape file (.shp) ? Cheers
Hi. I aim to reproject the coordinate system EPSG:25832 to a metric coordinate system. Which destination system do you recommend?
Hi everyoneI wanted to know if there is any workflow I can do to convert my points cloud to Cesium 3D tiles and I wanted to be also georeferenced ?
Hello, I asked the above question in the New To FME forum, but no takers. Lets see what happens here. My goal is to join CAD wall lines that are collinear and have a gap where the door is located (usually 36"). The LineBuilder does not have a conditional option. Two ways I can think of pursuing are:Group collinear lines that have a gap of 36" between end-point of one line and start-point of another. Lines have all been changed to a positive vector, so end-points are followed by start-points on X or Y axis.Use the CAD Door layer to locate prospective lines. These door symbols are blocks with an insertion point at the hinge. Very standard. Here is a screenshot, attached, of a typical hallway. There are large gaps which should be ignored and others that are approx. 36". On the left, you see two door setbacks. It is not a problem to separate horiz and vert lines if needed. Any help is appreciated. Thanks,@larue
Hello FME Experts that are far smarter than me, I have a very interesting text file that I need to isolate columns for to map points via lat and long values. Below is the URL to the dataset, it relates to fire weather conditions that are updated daily. https://www.wfas.net/images/firedanger/fdr_obs.txt I need to isolate the Colorado-related records and put all the values into their designated columns. If I use the standard text file reader, everything is mashed into one column (see screenshot). I tried using the CAT Reader, but can't seem to get that option to the right place. Does anyone know a better Reader or combination of Transformers that could help delineate these columns of data?
KML output written in kml_schema_data,I am not able to write in kml_data as shown in expected ouput image
I attach a visual example, from the visual preview, I want the blue tick row to merge/duplicate the attribute while the row with the yellow mark to keep the attribute value from the original value. Any help or guide will be appreciated. Thank you.
Hi , I have geospatial pdf has coordinates and I have shape file with other coordinates . i have read the pdf file with reader geospatial pdf and i can see that it has many layers and some data at pdf does not exist in my shape file and some exist i would like to change coordinates of geospatial pdf to same coordinates as shape file .How could I achieve that ? the shape file consists of lines and polygons (Buildings) and points some of buildings and lines ,i can find also at pdf file but in other coordinates .it locates far away of each other . i have used pdf reader ,parameters coordinate page point and enable non spatial read meta data objects ,Map frames The type coordinates of geospatial pdf is unknown for me .which transformers could be useful to move geo pdf to same location of coordinates as shape file ? i am thinking if there is any transformer to compare between shapes and find which polygon is exact as other then provide shape coordinates to pdf file fme 2021
Hi Team, I have a electric lines and electric devices . I want to split the lines where the device exist . I used the point on line overlayer with 0.001 tolerance . But its creating many new lines with 0.001 feet (less than a feet) lines .Ideally this shouldn't be . Its creating the issues when building the Utility network . can you please help me on this ?
Not sure if, while renewing, the new license overwrites the older one or do we do it manually?If the license is ok, is there a mistake in how I am using workbench?The license we have is a temporarily renewed free trial license. The error message in the image shows that. Please advice on the same.
Hi all, I have created a Choice user parameter and am importing the contents of the choice list (or dropdown) from a spreadsheet.The Import appears to decide itself how it wants to sort the contents of the list. Is there a way this sort can be turned off?I have already sorted the contents of the spreadsheet into the order I want, but the import kind of ruins this order, and then I am forced to manually reorder with the up and down arrows. This isn't too bad with a very small list, but is pretty frustrating with a much larger list (which I have). Plus I know I am going to have to refresh the contents of this list semi-regularly in the future.Does anyone know of a way around this? thankskeith
I am trying to extract the 1st and 4th word but it just keeps grabbing the first 4 words, I've tried without the ^ and it doesn't work
I have situation wherein I need to add fields to all the feature classes within a SDE. I cannot seem to figure out how to loop through the SDE, and operate on one feature class at a time, though. My first thought was to generate a list of all the feature classes in the SDE using two FeatureReaders, but then I was not sure how I would iterate through that list. Any assistance would be greatly appreciated. Thanks!
So apparently, FME does look for fields that might be a good candidate for creating a point geometry in both Excel and CSV readers (see https://community.safe.com/s/question/0D54Q000080hfENSAY/excel-format-of-attribute). This means that if in an Excel or CSV file, there is a row with column names such as X and Y, FME will automatically try to create a point with the contents of these cells. In the top-rated answer of the above link, it is mentioned that for the CSV reader, this will only occur if the option "Scan for types" is activated. This option does seem to be missing for the Excel reader, though, or am I overlooking something? I have the problem that I am using a FeatureReader to dynamically read from an Excel file (the specific file is only known at translation time, not before) and FME unwantedly tries to create point geometries for the features. The sheet of the Excel file might contain X and Y columns, but these are usually empty and surely not any spatial data. Nev
This is not a real question, it's more an assesment. In FME 2022, it seams that every query run with SQL Executor/Creator is run as a prepared statement (see here for more information on PostgreSQL https://www.postgresql.org/docs/current/sql-prepare.html). The problem is that only certain query can be prepared, not every one...Some of my queries can not work anymore like every "CREATE" queries that can not be prepared into PostgreSQL. Is there a way to disable this behaviour ? For me it's a critical problem because some times we need the queries to be run as we write them, not like the database want to redefine them.
We have one floating licence and it is now stuck on an old laptop and won't release it. Can I force it to release either from the device or from the licence server?
With a postgres writer it appears that if Bulk Insert is set to Yes, if you attempt to write a string value of NULL to a varchar column that has a Not Null constraint it is interpreted as a genuine null and results in a fatal errorError was 'ERROR: null value in column "value" violates not-null constraintIf Bulk Insert is set to No, the value is written as a string as expected Is this a known issue? This is in FME(R) 2021.2.6.0 (20220727 - Build 21821) so may have already been addressed.
Hi, I'm running into an issue that I don't understand the solution to.Using the geometries attached here, I can not clip the geometries using a tolerance of 0.001 .It does not give an error, it just gets stuck.If I dissolve the clippers before clipping, it does work. So I'm guessing there's something 'wrong' with the geometries (there is a strange pointy shape in the polygon) and the chosen tolerance, but I don't know why it gets stuck. I'm guessing the pointy-bit is too small and falls under the tolerance? I'm using fme 2022.1.2. Workspace attached and data attached.