Using readers and writers to extract and load data.
Recently active
Is there a way process OSM data so that I organise the most important tags into separate attributes while keeping all other key/value pairs e.g. by dumping them into another attribute called "othertags"?For example; an entry in my Highway table might look like this:highway trunk lanes 2 oneway yes width 12 othertags "surface"=>"asphalt", "name"=>"Ermine Street", "maxspeed"=>"70", "lit"=>"no", "ref"=>"A1", "name:en"=>"Ermine Street", "maxwieght"=>"..... Basically I don't want to lose any info, but I don't want to expose all tags to potentially several tens of mostly useless attributes.
Hello,I'm migrating some shapefiles using FME to a PostgreSQL/PostGIS database. Is there any way to monitor all of the SQL commands that have been sent to it during the translation ? Thank you.
Hi all.A problem that makes me crazy :-(To collect data form Oracle, I use an SqlCreator with a parametric query.When I run the same query in SqlDeveloper, I takes the correct number of records. Usually a single record.When I do the same in FME, the record is duplicated.The strange thing is that if the correct result is one record, it is duplicated. So two records.If the correct result is three records, the result is four. One duplicated and the other fine.The production landscape where the problem occurs has two FME servers with distributed engines.In the second landscape (testing), the problem doesn't happen.Very strange...Thanks for your supportRoberto
Hello everybody, I have to solve urgently problem with generating of SVG files. I still cant find way, how to define title of SVG file and also, how to insert my attribute after <g id> tag, see pic below? Please, do You have any tip, how to figure out this problem?Thank You so much!Lubo
I have ifctoCityGml template (no idea how it is working) and its working fine and convert my ifc to citygml but the only problem i am facing is that it is not exporting roof while it successfully exported WallSurface, FloorSurface and window. And here is its transformation snap:As you can see there is no output from FeatureMerger_2 Transformer. I guess Merged, is not producing any output.
I have an excel file containing 100,000 items placed in 700 boxes. The file has two columns, one column is the item and the other is the corresponding box. I would like to get them rearranged as a file with 700 columns and each column (box) has all it's corresponding items listed underneath. Attached is an example: Excel's Pivot table and FME's AttributePivoter are asking me to group the items by columns AND rows. But I don't have rows to group the items with. I just wanna group the items by columns.
I like to have a simple shapefile been written to CityGML.A simple task, I assumed, but it doesn't work out the way I want... at least, not in the end.The color and the transparency don't come with the CityGML file. What am I doing wrong or what am I missing here?Attached the Workspace and the data.
im trying to know if a feature is empty or not, iv tried a counter box butit does'nt do the job (but the counter receive no input).
Hello everyone, I'm getting a Python error when trying to add a ArcGIS Online reader. I noticed this today, but can't say for sure when exactly it happened. I'm getting this error in the console log:Creating reader for format: Esri ArcGIS Online (AGOL) Feature ServiceTrying to find a PYTHON plugin for reader named `ARCGISONLINEFEATURES'Loaded Python module `arcgisonlinefeatures' from file `C:\Program Files\FME\plugins/python27\arcgisonlinefeatures\__init__.pyc'Python Exception <ImportError>: No module named arcgisonlineCommonCould not create Python Reader `ARCGISONLINEFEATURES'A fatal error has occurred. Check the logfile above for detailsFailed to open the dataset '<Unused>'DATASET INFO:  DATASET: <Unused>  NUMBER OF PARAMETERS: 3    RETRIEVE_ALL_FS_NAMES = Yes    NC = envita<space>gis<space>Esri<space>ArcGIS<space>Online    _MERGE_SCHEMAS = YESSo it's complaining about the arcgisonlineCommon module, but I don't
Hi,I'm writing to a MapInfo extended tab, and noticed there is a delete operation on the tables. I have tested this out, and have got it to work, however the tables aren't compressing after and the deleted records are staying in the table albeit flagged for deletion. A pack of the table solves this, but cant it happen on closure of the writer?Cheers,James
Hello everyone reading this. I am new to gml conversion, so I seek help here.I am trying to read gml files provided with xsd schemas, validate them, insert those data into PostGIS database, do some database processing, then exporting data from database into gml files using same xsd schema (meaning output file should be more or less copy of input gml file, with less or more features)Importing gml files into PostGIS database is going fine, however I have several problems with exporting data, as the files differ in several places and I am unable to figure out how to duplicate the structure.Unfortunately I cannot provide xsd file and have to use modified gml, sorry :( I have several problems:gml file looks like this (change extension, website did not allow me to upload gml):1) FeatureCollection attributes.snippet of xsd:<xs:element name="FeatureCollection" type="eczr:FeatureCollectionType" substitutionGroup="gml:AbstractGML"/> <xs:complexType name="FeatureCollectionType">
The reader in my workspace is an ESRI shapefile. I am clipping this to a buffer, changing coordinate system (SnakeGrid) and writing to a MicroStation .dgn. I am copying all the attributes from the .shp and writing as tags. Can I do this for several .shp's at once and it only carry the necessary attributes for each .shp? When I input '*.shp' to read all .shp in a folder, it outputs then individually but with the attributes of all the input shapefiles.
i had 2 question ,1, how to create an empty polygon (i v tried with creator function but with no result)2, how to verify if a polygon had an entity or is empty ?
Is there any way to write merged cells in excel:
Hi I've a very funny error. I've never had it before. I created a new workspace and translate some data into an MAPINFO-Output. But I get this message in the log: ERROR |Destination Feature Type Routing Correlator(RoutingFactory): Failed to open FME feature store file `' for write -- ensure that the folder exists INFORM|=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- INFORM|Feature output statistics for `FFS' writer using keyword `W_2': STATS |=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- STATS | Features Written STATS |=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- STATS |============================================================================== STATS |Total Features Written 0 STATS |=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- STATS |Stored 0 feature(s) to FME feature store file `' ERROR |Failed to open FME feature store file
Hello. I am trying to use the Esri ArcGIS Portal Feature Service Reader/Writer in FME Desktop 2018.1 and am getting a Python KeyError exception when trying to authenticate the login. I am using "Generate Token" as the authentication type, and trying to connect to an instance of Portal for ArcGIS (10.6.1).Here's the relevant excerpt from the log:|INFORM|ArcGIS Portal Feature Service Writer: Logging into '[host url]' as user '[username]'|ERROR |Python Exception <KeyError>: u'token'|ERROR |A fatal error has occurred. Check the logfile above for details|ERROR |... Last line repeated 2 times ...The strange thing is that this workspace ran successfully a few days ago.Any input would be appreciated. Thanks!
. The data contains englands ceremonies as polygons. After converting the shp according to this demo https://knowledge.safe.com/articles/775/inspire-gml-basic-writing-example.html only a few polygons get the geometry attributes.fme_geometry (string) fme_aggregatefme_type (string) fme_areaxml_type (string) xml_areaMost of the polygons get these kind of geometry attributesfme_geometry (string) fme_undefinedfme_type (string) fme_no_geomxml_type (string) xml_no_geom--------------------------------------------This is my project. Kind regardsNico
I have a GoogleDriveConnector connected to my account so that it lists all of the pdfs from a folder. As soon as there are more than 100 files in the folder, GoogleDriveConnector just keeps running forever (it got to 32000 outputs before I stopped it)With 91 files it works correctly :After uploading 10 more files the transformer gets to 741 outputs and would keep increasing if not stopped. Is there a way to fix this issue?I've tested on different files/accounts and nothing seems to help.
I have windows, walls, doors etc object in IFC when I view it in FXKViewer. But after converting the IFC into CityGML all the objects are appearing with genobj:GenericCityObject name. What i am doing wrong? I have just generate CItyGML from IFC.
Hi, I was wondering of it is possible to use an if statement in the Pointcloudexpressionevaluator to calculate values based on values of other components. I created a pointcloud with different z components (for example z_2018_01 and z_2018_02), these z values represent measures in different months in 2018 . There are also components that represent the year and month (YM_2018_01 filled with value 20801 and YM_2018_02 filled with value 201802) There are also points that have only one measure value (or in period 1 or in period 2), see table below. From these z components I want to calculate a z_actual (most recent z value). Is there a way to use the Pointcloudexpressionevaluator? An expression like : “If JM_2018_02 > JM_2018_01 then z_2018_02 else z_2018_01” will be useful but I don’t know of this is possible, and if, how to build such an expression in the Pointcloudexpressionevaluator. Can anyone help me? I prefer the pointcloud transformers because it gives a very good performance, (
Hi, I have many rasters in file gdb with lower case file names. I need to rename them by adding a prefix to all file names and also change their names from lower case to upper case. My goal is move them to ArcSDE after renaming them.
I'm trying to convert a raster (orthophoto) in to a geotiff, using jpeg compression method and enabling the BigTIFF advanced option. However I'm unable to successfully run the conversion with both options selected. Is there a reason why I'm unable to convert my orthophoto to a geotiff using both jpeg compression and BigTIFF at the same time?
Hi folks,Most of the new functionalities in the recent forum update are really nice, however there are a few regressions that are pretty annoying:1) The code editor displays a lot of unnecessary "Â" characters in indented code, see e.g. https://knowledge.safe.com/questions/82001/how-to-convert-csv-data-in-a-single-attribute-to-a.htmlI've tried a lot of different strategies to get rid of them, all unsuccessful.https://knowledge.safe.com/questions/81538/create-a-halton-sequence-with-python.html?childToView=81545#answer-815452) There's something strange going on with search, e.g. looking for "halton" which was mentioned several times in the posting above (posted after the upgrade) turns up nothing: https://search.safe.com/#q=halton&sort=relevancy3) I keep on having to sign on to the forum, it seems I get disconnected several times per day, sometimes several times within just a few minutes. This was not the case before, where I remained logged in for weeks a
HiI am extremely new to this but I have been asked to learn HTML/CSS/JAVA and FME and come up with a solution. I am trying to extract data from the tabs on https://travel.gc.ca/destinations/bangladesh and write them into a single list in HTML that I can then use later. In my workbench I have it extracting and writing to Excel and and HTML file. Currently it writes all the tabs to excel (although it looks like jargen) but I can only do one tab at a time in the HTML? Is there a way to one remove all the HTML "code" from the excel and two write multiple tabs into the single HTML file? thank you
While converting from 3DS to CityGML, I am not able to get layer by layer information on the GML file. The 3DS file got 7 layers but the GML file Just got one object. How can I solve this?