Transformers

I have a dataset of around 85k road segments and 130k non-road segments where I want to cut off small parts of the roads around the non-road segments: There's a buffer around each of the non-road segments that I use as clipper on the roads.I've applied all the tips given in this thread ( https://knowledge.safe.com/questions/62461/why-the-clipper-transformer-is-too-slow.html ). I forced the clipper to wait until all clippers were available, I dissolved both datasets before clipping and it works fine on smaller datasets. Still, it takes around 2 seconds per feature in the dissolved dataset (total 12k). I've even discarded all attributes.Algorithmically, clipping polygons should take nowhere near as long when everything fits in memory. [M. de Berg et al. Computational Geometry. Ch2 ]Is there anything I've missed? Why is clipping so slow?

Hello! I am currently starting working on gbXML to CityGML conversion, using FME. I know that gbXML is not supported right now, so I am trying to use xml reader. Maybe someone has already tried this conversion, or has some ideas/hints on what could be useful for me. Any help would be appreciated.

Can a revit model and a primavera schedule be integrated into GIS?

I am reading features from an Excel sheet and writing those features into a table in a File Geodatabase.I have noticed that string attributes without values in the Excel sheet are written as empty strings in the File Geodatabase instead of being Null.Is there a way to write those as Null instead?

Hi all,In autocad, I have a file containing information I would like to merge.Using the picture below will help to figure out the situation :I have a block and texts. I want to add the text string "(1.00) Z=190.98" to a new attribute of my block.Offsets between text insertion's point and block insertion's point are always the same offset x= 0.14 offset y = -1.25.Then the next step is to compute the value. Ideally, the attribute must have the calculated value 191.26-1.40= 189.86. Any ideas ?Thanks Arka

I am trying to read the results for a SQLExecutor. The transformer does not have the possibility to expose schema features. And I would need it (rather than reading the table from the DB with a FeatureReader)following the advice from the answers for this question:I am using Python to read the feature name and types and create a schema feature with the formatattribute{n}.fme_data_typeattribute{n}.nameimport fmeimport fmeobjects# Template Function interface:# When using this function, make sure its name is set as the value of# the 'Class or Function to Process Features' transformer parameterdef processFeature(feature):    feature_attr_names = feature.getAllAttributeNames()    i = 0    for feature_attr_name in feature_attr_names:        feature.setAttribute('attribute{0}.fme_data_type'.format(i), feature.getAttributeType(feature_attr_name))        feature.setAttribute('attribute{0}.name'.format(i), feature_attr_name)        i+=1    passWhen it comes to expose the attributes I create FME d

I have scaled a point cloud, and then rounded the values. So for example the points(2555, 1467, 8695) and (2599, 1401, 8622) became (25.55, 14.67, 86.95) and (25.99, 14.01, 86.22)after rounding they both become the same point (25.0, 14.0, 86.0)This means I now have duplicate information, and it's making my .LAS file needlessly large. Is there a way I can coalecse these points into a smaller point cloud output?

Hi,I have this proj4 config that I had converted to FME custom coordinate system. However, when I run a reprojection transformer on it, it gives me an error.Below are the details. Can anyone shed some light on this error?Thank you!Proj4 config:  +proj=tmerc +lat_0=0 +lon_0=120.95 +k=0.9999 +x_0=446904.02 +y_0=2879827.84 +ellps=GRS80 +units=m +no_defs FME custom local coordinate:COORDINATE_SYSTEM_DEF ER94 \\   PROJ TM \\   UNIT METER \\   DT_NAME ER94 \\   DESC_NM "ER94" \\   GROUP ASIA \\   SOURCE "ER94" \\   ORG_LAT 0 \\   PARM1 120.95 \\   SCL_RED 0.9999 \\   X_OFF 446904.02 \\   Y_OFF 2879827.84 FME ERROR when trying to reproject:Datum definition ER94 does not exist.Storing feature(s) to FME feature store file `.\\mapping_log.f

Is there a way to set the permissions on particular dashboards in fme server. I created a custom dashboard and can see it in dashboards area and have given permission for user to see but I only want user to see that particular dashboard, not all of the dashboards available.

Can anyone help me to convert my autocad file to geotiff?Please.Thank you

Are there video tutorials on the FME AR transformer?

I have multiple layers of client regional data from which I would like to extract data for a specified study area which will be defined using a polygon in mapinfo tab format. I have tried to use an AreaOnAreaOverlayer to capture the data within the boundary however I am struggling to make this work. Any suggestions?

Hi,I have a FME workspace which is intended to converting data from any format/schema into a defined standard personal gdb format which we have defined internally. I would like to create a published parameter exposing attributes of the source dataset (eventually picked upfront by the user in a separate published parameter) and allowing the user to choose the appropriate attribute which needs to be used by the workspace (example: "Pick street name field"). Schemas and attribute names are not known in advance and I would prefer avoiding using the SchemaMapper plus asking users to update a separate schema file upfront every time new source material needs to be processed. Does FME provide a solution for fetching attribute names at runtime (a published parameter could probably call another FME worskpace or script retrieving those names and returning them into a drop-down in the prompt window)?Thank you for your suggestions!Olivier

I need to read an Adobe FrameMaker file to extract data and export to other formats. Please let me know if there are any readers, as I did not find the current FME list

I have a problem with parsing JSON which is the result of an HTTP call to get what I need. (See json files attached.)If I download the .json file and simply put it in a JSON reader with a query,filter for type:"Update Feature Attributes" and explode some of the lists, it gives me what I need:My problem is that I have loads of transactions to go through the same way, so I'd need to use an HTTPCaller. I've managed to get that far that with a JSONExtractor I can get "type", "ID" for example, but struggling to break down lists "attributesAfterChange" and "changedAttributesNames" - ListExploder doesn't recognise them as lists for some reason. Any ideas what should I do to get the list values/break down the arrays? Maybe it's very simple but I just cannot find a solution right now. NB: the attributes in these lists vary and not exclusive to what's in the attached json files, so somewhat making it a bit more complex...Any h

I'm testing a workflow that permit to rollback all the changes made in a workbench execution. There is a possibility to rollback some operations from start to end including the truncate operation?I have a workflow that read data from a source and write in another one. Writers are set to truncate. If the write process has an error and the workbanch has a failure the truncate process is commited. I'm not able to rollback before the truncate step. Anyone has an idea?A possibility is to have a staging area and if the workbench is completed without problems a second workflow start with the real update from staging area to the work area.

I have a PDF file which consist of few pages (2-3). When I run the translation see attached , the results are 2-3 sepatated files. I need to have them as an JPEG but as 1 file. I have no page numbers to set an attribute pdf_page_number. Have a houndreds of those files. Some of them have only 1 page but some a few pages. So I need something what will also recognize what has more than 1 page.

Dear all, I having problems with writing an - character in a fieldname. If i chance it to - then FME will automaticaly change it to _ (underscore) do have have a idea?I use the writer Spatialite. FME 2017.1. If i manualy change it to - then FME changes it to _....

BonjourJe cherche une solution pour mesurer la longueur d'un solidej'explique je cherche a identifier des lignes qui coupent des solides pour cela je transforme les lignes en solide avec un bufferer et les passent dans un clipper ensuite je voudrais mesurer la longueur des lignes qui sont dedans et hors du clipperil me faudrait la meme fonction qu'un centerline replacer qu'on utilise pour une surfaceHello I am looking for a solution to measure the length of a solid I explain I am trying to identify lines that cut solids for that I turn the lines into solid with a buffer and pass them in a clipper then I would like to measure the length of the lines that are in and out of the clipper I would need the same function as a centerline replace that is used for a surface

Hello,I am building a 3D from a shape solid by extruding in Z dimension based on a value. I then add an image texture on the front face and finish with a .obj writer.The shape consists of 31 features, each greater containing the previous ones, and with quite complex shapes (numerous vertex).I manage to produce a visualisable 3D object with texture (I can also visualise it in GLC player) but when I try to upload it on a printer website (such as Sculpteo), further processing cannot be done because the object is not valid, with lots of singuliar edges, and I don't understand why.What tools can I use in FME to clean the object without changing its layout? I can send the input shapefile, the image used for the texture (though I'm pretty confident this is not the problem) and the workbench if needed. I can also send some screenshots of the diagnosis generated by the printer website.Thanks a lot!Jean 

Hi all,I'm trying to create a Mesh out of Esri Shape polylines. I have shape files from a public transport network and need them as a 3d model (FBX). The single lines do not have the same z-values, they are changing. You can find my workbench in the attachments. Unfortunately the ascii grid file is too big to upload here. My workbench "works", i'm getting an FBX but i loose the z-values at the bufferer, so my Model is extruded but all lines are on the same altitude. After some research i found the 3DBufferer (Now Hub3DBufferer) but FME stopps the translation after around 1h with the following messages:Extruder_Rejector(TestFactory): Extruder_<REJECTED> Feature Counter -1 2147680263: Failed to seek to beginning of `%0' -- perhaps there is not enough disk spaceFailed to seek to beginning of `C:\\Users\\Clement\\AppData\\Local\\Temp\\no-conn-ffs-1512660184987_17620.ffs' -- perhaps there is not enough disk spaceI have 120GB of disk space, so i'm not sure

Hi,I've found how to get the latest file from a directory and get the file name. I now need to pass this file name to a JSON reader. I'm having difficulties in doing this. I realize that the FTP Watcher in Server would be my best bet, but unfortunately we don't have FME Server available. I will be using another program to download the json files from the FTP server. Then using PATH with Sorter and Sampler to get the latest file. I've tried to use the Feature Reader setting it to JSON with the pathfilename , but must not have the proper items set up as of yet as it rejects what I've entered. This data is ultimately to merged with a feature dataset to map specific points based on one column that is unique between the two.

Hi,I have a workspace that uses the custom FeatureCounter followed by a TestFilter. If too many features for my conversion I port to a Terminator transformer. Following termination I want to delete the input file as part of a Python Shutdown script. The path including filename are in a Published Parameter. Example: [source_file]: c:\\folder\\file.extI've looked at lots of info but my attempts produce errors or the file doesn't get deleted, or both.Can someone with good experience with this provide details on all lines needed in the shutdown script (and if needed, any Python needed in the body of the workspace)?Thanks!

@takashi I have a dataset like this:DateValue01/01/2018201/01/2018001/05/2018301/12/2018102/01/2018302/02/20184I want to create an attribute for Daily Average Value in Each Month, and store the daily average (sum of values within each month ÷ number of days in that month).The denominator is where I'm having trouble. Any suggestions on the best way to find the number of days within a given month?

HiFor different reasons I am trying to use FME Server to run a batchfile scheduled.The batchfile's task is to run a specified Powershell-script that converts a spreadsheet to PDF using MS Excel.(Yes, if FME would have had a proper plain PDF-writer I would have used this.). Both powershell-script at batchfile are working flawlessly when used manually.I've created a workspace with a systemcaller to run the batch-file. When I start this workspace, it runs the batchfile and it does what it is supposed to do, and fme logs what is happening.From the fme-log:SystemCaller: Executing `C:\Scripts\RunPowershellScript.bat'Z:\Some\network\address>>ECHO *********************************************************Z:\Some\network\address>>ECHO ** run powershellscript to convert spreadsheet to pdf. ** ** run powershellscript to convert spreadsheet to pdf. **Z:\Some\network\address>>ECHO *********************************************************Z:\Some\network\address>PowerShell -NoProf