Using readers and writers to extract and load data.
Recently active
HiI need to extract info from XMLI used the HTPP caller but now I need to extract the string related to tag <tbody> (see picture) and I don't know how can procede thx Francesco
Hey, I am dealing with a data migration from File Geodatabase to Microstation DGN right now. I am wondering whether it is possible to set the value for the attribute igds_model_name in the DGN Feature Writer. The only accesible attribute is igds_xref_model_name. But I need igds_model_name, because right now all written features get the value Default, which is wrong. The values I want to write are RB, GEM and DIG. They are currently saved in an attribute in a File GGeodatabase.
I have a workspace to convert shapes files to Postgis 1.5 working fineIn the same workspace, I change the conection parameters to conect the same table in Postgis 2.1 but I get an error because of Srid restriction.Reading the log, I see is trying to write SRID=1 (the postgis restriction is to Srid=25830, in both versions of Postgis, so it returns an error)The conection parameters are the same in both conectionsIf I inspect the entity that its trying to write, the properties gives EPSG:25830 Coordinate System,but in the log writes SRID=1Why is trying to load Srid=1 when I change conection to Postgis 2.1? Thanks
I have two KMZ files containing states and cities borders. I want to combine them and find out which city falls under which state as a result in some tabular format. How I can achieve this with FME? Are there any transformers available for this?
I do not see a reader yet that can read a GeoJSON file in S3. Rather than needing to download it via the S3 transformer.We would like to use S3 as a spatial data hub so it can be used by many tools.
I'm using FeatureReader with following parameters:Dataset: $(Source_WFS:)Feature Types To Read – From Attribute: _FETURE_TYPES$(Source_WFS:) is composed of some fixed URL address (below is an example one, not the real one I'm using) plus dynamically generated token by Python script in private parameter called Token which is:import fmeobjectsimport urllibimport urllib2import jsonusername = FME_MacroValues['Username']password = FME_MacroValues['Password']client = FME_MacroValues['Client']expiration = FME_MacroValues['Expiration']format = FME_MacroValues['Format']url = 'https://www.example.com/tokengen/'values = {'username': username, 'password': password, 'client': client, 'expiration': expiration, 'f': format}data = urllib.urlencode(values)request = urllib2.Request(url, data)response = urllib2.urlopen(request).read()jsonToken = json.loads(response)return jsonToken['token']This worklfow works perfecty in FME 2014, but in FME 2018 I get the error, when trying to load features to Output po
Hi. I want to export some fields from shape file to excel. Any help in this regard would be highly appreciated.
Hi all,I've 3D model of building sample as you can see at the .jpg file.I worked in the .dgn file.But when i import .dgn file to FME data inspector i've more geometry about drawing.I think that FME is handing logs .dgn file geometry history cause i copied exactly same coordinate into building room drawing geometry. So, how can i resolve this problem? Can i resolve in FME Desktop with transformers? (MS Drawing)(Same .dgn file looks in FME)
Hello, What we do is get KMZs and run the ArcGIS tool to convert them to to layers in a file GDB. When you use the layer in ArcMap there is a field PopupInfo, which has HTML data we need to extract?? I have tried several recommendation with HTML, but nothing gets me to where I can flatten the data out into a usable table. Please let me know any suggestions?
Hi there... Sorry about my English. I'm trying to translate survey drawings made in Autodesk Civil 3D 2017 and 2019 to GDB using CoGoPoints and Survey Figures. For CoGoPoints no problems at all, but Survey Figures are not supported at my FME ESRI Desktop 2017.0.0.1.If the Survey Figure is supported by FME Desktop 2018 or newest, I will ask to my company for a software update, if not I need change my strategy. Thanks in advance! Demetrius
Hello - part 2 of an XML thread. I have a bunch of nodes in an XML document that look like this;<nodes> <node> <properties> <property type="field_name">first_name</property> <property type="field_data">Ben</property> </properties> </node> <node> <properties> <property type="field_name">last_name</property> <property type="field_data">Potts</property> </properties> </node></nodes>And I want to get those out as variables to use down the line in an FME workbench. At the moment I am relying on the order of them in a Test Filter (i.e. If @Value(_attr_name) = nodes.node{0}.properties.property{1} = first_name then put it on an output port of 'first_name') - however I hate relying on the order and I'm sure there is a better way of ge
Hi All,I'm getting a fatal error that I can't figure out the source of.2019-04-12 11:44:31| 1.2| 0.1|FATAL |Precondition failed at stfchainsegmentmodifier.cpp:1093. Expression: prevRealNode_->arcInfo_ != nullptrI think it occurs as the result of either a Geometry Extractor or Snapper transformer I don't understand what it means. Any ideas?Thank you!Katrina
Hello, I am dealing with large LAS file that is output of AgiSoft Photoscan. I need to generate break lines and isohypses. In this question I have seen the potential solution but I think this can't solve both of my needs. I hope I can get some hint. Thank you all in advance,With respect, Dejan
How to set the colour of the linetype of text to be 'by layer' in a DWG? I learned from https://knowledge.safe.com/questions/30155/how-to-set-bylayer-color-in-a-gis-to-cad-transform.html that autocad_color = 256 will set the colour by layer, not by entity (which doesn't make sense, but apparently is the answer, and it does work for me). However, this only works for lines and arcs - for text, the text is still coloured 'by entity'. I am transforming a DWG to a different configuration of DWG (seeing layer names, colour, splitting by an input layer, etc) so no major changes. I just can't figure out how to manipulate this particular item
If using the DGNV8 reader and choosing to Drop Complex Chains/Shapes is there any common attribute between features that originated from the same complex shape?
Greetings for the day, I am working with IfcOpenShell and Python on the extraction of IFC entities. I have developed a Python code which I want to use to extract the structural model from the architectural model. But there is an issue which I am not able to understand and resolve because I am a beginner. When I try to extract the entities which do not contain any entity written in bracket the code runs accurately. for example:- #1=IFCPERSON($,$,'',$,$,$,$,$); #2=IFCORGANIZATION($,'',$,$,$);But the issue occurred when I want to extract the entities with previous entities written in Brackets for example:- #3=IFCPERSONANDORGANIZATION(#1,#2,$);The issue was that when I try to extract the entity for example "IFCPERSONANDORGANIZATION", the code will extract the "IFCPERSON" and "IFCORGANIZATION" twice if I have already extracted these two entities as done in the code given below.Please help me with this issue.
Hi, I hope someone here can help me out.I have ArcGIS Pro Advanced license plus Data Interoperability license.When I was using Pro 2.2, there was no problem. But since I upgraded Pro to 2.3 and Data Interoperability as well, I keep getting FME Desktop License Assistant when I launch Data Interoperability.Has anyone experienced same issue?I really need this tool for my UNME work.Thanks for your attention. Regards,Min
Authentication fails when attempting to connect to ESRI ArcGIS Online feature service writer. After entering organizational credentials for AGOL, the error states "Failed to Obtain Refresh Token: Error retrieving access token". The translation log reads "java.lang.NoSuchFieldError:INSTANCE". I experienced this problem with FME desktop ESRI Edition v2017.0 and after upgrading to 2017.1 the issue still persists.
Hi, I have a Geopackage raster tileset that contains a raster with multiple zoom levels. I want to split this raster into a series of tiles and export each tile as a TIFF file. My first thought was to use the RasterTiler-transformer and simply split the raster tileset into separate tiles based on a specific tile size (e.g. 500 x 500). However, I can't get this to work. When I run the workspace the resulting TIFF-files contain no data (i.e. they are totally blank). I suspect that this has something to do with the multiple zoom levels in the Geopackage raster tileset, but I'm kind of clueless on how to solve it. Does anyone have an idea on how to solve this? Is it possible to split a Geopackage raster tileset into a series of tiles based on multiple zoom levels? Any help will be appreciated.
Hi all,I have some DBF files that need to be converted to something else (MSSQL tables), but have a problem reading these in FME. The dbf files have associated "FPT" files which are memo files.When reading the DBF files in FME, an error arises "DBF Reader: Failed to read memo file record at block number %0. DBF Writer: Error with memo file. Unable to input data from file 'Y:\\Data Transfer\\WATERCOURSES.DBF'. Error in the DBF Reader. Failed to specify the feature index as constraints on the reader.""DBF Reader: Failed to open memo file 'Y:\\Data Transfer\\WATERCOURCES.fpt' for reading"I have then tried to remove the "fpt" file and doing so allows FME to read the DBF. However, there might be some important data in these "fpt" files that we do not want to lose.My question is what is the problem with the "fpt" files and how can it be sorted out in order to get the dbf files read in FME without removing the fpt fil
I'm using the Data Interoperability extension and I'm attempting to read in a csv file that has a column with a string of coordinates in it. I've tried loading it into the Spatial ETL Tool CSV reader, using the coordinate concatenator and then the area builder. I get a rejected feature warning when I try running the tool. Can anyone offer some pointers for this?
For every feature I have a photo. These photos can have different formats, e.g. png or jpg. The photos are on our intranet. I can only download them with a valid Authorization parameter in the request header. I'd like to write the features to an Excel file, including a photo for every row. How should I go about that?I tried following this tutorial, but the ImageFetcher didn't work because of the missing Authorization header parameter (I don't know how to specify the header parameter in ImageFetcher). An HttpCaller does work. I can download the photos to an attribute or file on my local disk. But I don't know how to feed the photos to the Excel-writer. I'd really appreciate your help on this.Willy
Hello,I'm using ExcelToPDFWriter to export Excel files into PDF. It works fine.But my Excel files are huge and many informations are useless (for me). I would like to decide which rows/columns for the sheets I want to export to PDF.Do you have an idea how I could to that? Changing the Python code maybe?Thanks!
I want to create a plugin that will take some data from the small world and send it to another application. How can I get access to the small world database? What kind of problems can I face?
I'm processing a vector data containing 500000 features to a raster data using numeric rasterizer and then writing it in a raster gdb. The conversion of vector to raster happens quickly but writing the raster in to the gdb takes unexpectedly more time. It runs for hours. I'm not sure how can I improve the writing time. Please help!