Using readers and writers to extract and load data.
Recently active
I have an excel file containing 100,000 items placed in 700 boxes. The file has two columns, one column is the item and the other is the corresponding box. I would like to get them rearranged as a file with 700 columns and each column (box) has all it's corresponding items listed underneath. Attached is an example: Excel's Pivot table and FME's AttributePivoter are asking me to group the items by columns AND rows. But I don't have rows to group the items with. I just wanna group the items by columns.
I like to have a simple shapefile been written to CityGML.A simple task, I assumed, but it doesn't work out the way I want... at least, not in the end.The color and the transparency don't come with the CityGML file. What am I doing wrong or what am I missing here?Attached the Workspace and the data.
im trying to know if a feature is empty or not, iv tried a counter box butit does'nt do the job (but the counter receive no input).
Hello everyone, I'm getting a Python error when trying to add a ArcGIS Online reader. I noticed this today, but can't say for sure when exactly it happened. I'm getting this error in the console log:Creating reader for format: Esri ArcGIS Online (AGOL) Feature ServiceTrying to find a PYTHON plugin for reader named `ARCGISONLINEFEATURES'Loaded Python module `arcgisonlinefeatures' from file `C:\Program Files\FME\plugins/python27\arcgisonlinefeatures\__init__.pyc'Python Exception <ImportError>: No module named arcgisonlineCommonCould not create Python Reader `ARCGISONLINEFEATURES'A fatal error has occurred. Check the logfile above for detailsFailed to open the dataset '<Unused>'DATASET INFO:  DATASET: <Unused>  NUMBER OF PARAMETERS: 3    RETRIEVE_ALL_FS_NAMES = Yes    NC = envita<space>gis<space>Esri<space>ArcGIS<space>Online    _MERGE_SCHEMAS = YESSo it's complaining about the arcgisonlineCommon module, but I don't
Hi,I'm writing to a MapInfo extended tab, and noticed there is a delete operation on the tables. I have tested this out, and have got it to work, however the tables aren't compressing after and the deleted records are staying in the table albeit flagged for deletion. A pack of the table solves this, but cant it happen on closure of the writer?Cheers,James
Hello everyone reading this. I am new to gml conversion, so I seek help here.I am trying to read gml files provided with xsd schemas, validate them, insert those data into PostGIS database, do some database processing, then exporting data from database into gml files using same xsd schema (meaning output file should be more or less copy of input gml file, with less or more features)Importing gml files into PostGIS database is going fine, however I have several problems with exporting data, as the files differ in several places and I am unable to figure out how to duplicate the structure.Unfortunately I cannot provide xsd file and have to use modified gml, sorry :( I have several problems:gml file looks like this (change extension, website did not allow me to upload gml):1) FeatureCollection attributes.snippet of xsd:<xs:element name="FeatureCollection" type="eczr:FeatureCollectionType" substitutionGroup="gml:AbstractGML"/> <xs:complexType name="FeatureCollectionType">
The reader in my workspace is an ESRI shapefile. I am clipping this to a buffer, changing coordinate system (SnakeGrid) and writing to a MicroStation .dgn. I am copying all the attributes from the .shp and writing as tags. Can I do this for several .shp's at once and it only carry the necessary attributes for each .shp? When I input '*.shp' to read all .shp in a folder, it outputs then individually but with the attributes of all the input shapefiles.
i had 2 question ,1, how to create an empty polygon (i v tried with creator function but with no result)2, how to verify if a polygon had an entity or is empty ?
Is there any way to write merged cells in excel:
Hi I've a very funny error. I've never had it before. I created a new workspace and translate some data into an MAPINFO-Output. But I get this message in the log: ERROR |Destination Feature Type Routing Correlator(RoutingFactory): Failed to open FME feature store file `' for write -- ensure that the folder exists INFORM|=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- INFORM|Feature output statistics for `FFS' writer using keyword `W_2': STATS |=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- STATS | Features Written STATS |=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- STATS |============================================================================== STATS |Total Features Written 0 STATS |=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- STATS |Stored 0 feature(s) to FME feature store file `' ERROR |Failed to open FME feature store file
Hello. I am trying to use the Esri ArcGIS Portal Feature Service Reader/Writer in FME Desktop 2018.1 and am getting a Python KeyError exception when trying to authenticate the login. I am using "Generate Token" as the authentication type, and trying to connect to an instance of Portal for ArcGIS (10.6.1).Here's the relevant excerpt from the log:|INFORM|ArcGIS Portal Feature Service Writer: Logging into '[host url]' as user '[username]'|ERROR |Python Exception <KeyError>: u'token'|ERROR |A fatal error has occurred. Check the logfile above for details|ERROR |... Last line repeated 2 times ...The strange thing is that this workspace ran successfully a few days ago.Any input would be appreciated. Thanks!
. The data contains englands ceremonies as polygons. After converting the shp according to this demo https://knowledge.safe.com/articles/775/inspire-gml-basic-writing-example.html only a few polygons get the geometry attributes.fme_geometry (string) fme_aggregatefme_type (string) fme_areaxml_type (string) xml_areaMost of the polygons get these kind of geometry attributesfme_geometry (string) fme_undefinedfme_type (string) fme_no_geomxml_type (string) xml_no_geom--------------------------------------------This is my project. Kind regardsNico
I have a GoogleDriveConnector connected to my account so that it lists all of the pdfs from a folder. As soon as there are more than 100 files in the folder, GoogleDriveConnector just keeps running forever (it got to 32000 outputs before I stopped it)With 91 files it works correctly :After uploading 10 more files the transformer gets to 741 outputs and would keep increasing if not stopped. Is there a way to fix this issue?I've tested on different files/accounts and nothing seems to help.
I have windows, walls, doors etc object in IFC when I view it in FXKViewer. But after converting the IFC into CityGML all the objects are appearing with genobj:GenericCityObject name. What i am doing wrong? I have just generate CItyGML from IFC.
Hi, I was wondering of it is possible to use an if statement in the Pointcloudexpressionevaluator to calculate values based on values of other components. I created a pointcloud with different z components (for example z_2018_01 and z_2018_02), these z values represent measures in different months in 2018 . There are also components that represent the year and month (YM_2018_01 filled with value 20801 and YM_2018_02 filled with value 201802) There are also points that have only one measure value (or in period 1 or in period 2), see table below. From these z components I want to calculate a z_actual (most recent z value). Is there a way to use the Pointcloudexpressionevaluator? An expression like : “If JM_2018_02 > JM_2018_01 then z_2018_02 else z_2018_01” will be useful but I don’t know of this is possible, and if, how to build such an expression in the Pointcloudexpressionevaluator. Can anyone help me? I prefer the pointcloud transformers because it gives a very good performance, (
Hi, I have many rasters in file gdb with lower case file names. I need to rename them by adding a prefix to all file names and also change their names from lower case to upper case. My goal is move them to ArcSDE after renaming them.
I'm trying to convert a raster (orthophoto) in to a geotiff, using jpeg compression method and enabling the BigTIFF advanced option. However I'm unable to successfully run the conversion with both options selected. Is there a reason why I'm unable to convert my orthophoto to a geotiff using both jpeg compression and BigTIFF at the same time?
Hi folks,Most of the new functionalities in the recent forum update are really nice, however there are a few regressions that are pretty annoying:1) The code editor displays a lot of unnecessary "Â" characters in indented code, see e.g. https://knowledge.safe.com/questions/82001/how-to-convert-csv-data-in-a-single-attribute-to-a.htmlI've tried a lot of different strategies to get rid of them, all unsuccessful.https://knowledge.safe.com/questions/81538/create-a-halton-sequence-with-python.html?childToView=81545#answer-815452) There's something strange going on with search, e.g. looking for "halton" which was mentioned several times in the posting above (posted after the upgrade) turns up nothing: https://search.safe.com/#q=halton&sort=relevancy3) I keep on having to sign on to the forum, it seems I get disconnected several times per day, sometimes several times within just a few minutes. This was not the case before, where I remained logged in for weeks a
HiI am extremely new to this but I have been asked to learn HTML/CSS/JAVA and FME and come up with a solution. I am trying to extract data from the tabs on https://travel.gc.ca/destinations/bangladesh and write them into a single list in HTML that I can then use later. In my workbench I have it extracting and writing to Excel and and HTML file. Currently it writes all the tabs to excel (although it looks like jargen) but I can only do one tab at a time in the HTML? Is there a way to one remove all the HTML "code" from the excel and two write multiple tabs into the single HTML file? thank you
While converting from 3DS to CityGML, I am not able to get layer by layer information on the GML file. The 3DS file got 7 layers but the GML file Just got one object. How can I solve this?
Hi all,I am using FME Desktop to convert some spatial DBF files to MapInfo Tab files. I'd like to ask if there are any restrictions for doing this operation. While the operation is running successfully, no geometry is being copied from the source files.Kind regards,
I'm trying to create a workspace to create a XML file from an excel-report (Sample) and an excelfile containg some other information (Blad1). However I'm running in to issues with the encoding of the created file. It seems like textwriter is not able to output UTF-8 encoded characters (input contains Swedish characters like åäö). Trying to understand where in the process this gets wierdly formatted but loggers seem to show the right characters. When I exchange these characters manually in the output XML file the validationservice I'm using is working. Anyone who can point out how to fix this? Kind regards.
Hi,Apparently (this is new to me too) the ESRI Shape definition has been expanded with a "code page file" (*.cpg), which contains the "code page" of the table structure, i.e. field names.I've just received such a data set, but FME doesn't seem to recognize this extension. My field names end up as un-decoded UTF-8 string, e.g. "ByggeÃ¥r" instead of "Byggeår".Is it possible to have FME (2017.1) recognize this extension, or if not, are there any plans to do so ?Cheers
Hi, I am trying to load features from ESRI file GDB to another ESRI File GDB schema. Geodatabase Error (-2147220987): The user does not have permission to execute the operation.FileGDB Writer: A feature could not be written. I am using ArcGIS version 10.14 and FME Desktop version 15.1 Thanks, Shahid
Hi,In regards to my previous question, I have tried finding how to read shapefile from AWS directly and read it (though seems to be quite slow). This possibility can neglect the use of multiple WorkspaceRunners(and I am still not sure how to use that)shp reader- Select file from web- Browse S3- Authenticate- Choose shapefile.my case:C:\PATH\ABC\ABC_Q1.SHPC:\PATH\ABC\ABC_Q2.SHPC:\PATH\ABC\DEF_Q.SHPC:\PATH\ABC\GHI_Q2.SHPSo, I can basically select 1 shapefile and process it at one go but really not sure about reading multiple filesin one go.S3 path: fme://amazon-s3/ABW_C_Q4.zip?id=prithvi-output%2FqualityLevel%2FABW%2FABW_C_Q4.zip&connection=parashas%20Amazon%20Web%20ServicesTried using * in place of ABW_C_Q4 and ABW but doesn't really help.