Using readers and writers to extract and load data.
Recently active
Using a JSONFormatter (pretty) and JSON Writer in series, the output file contains literally the characters \\r\\n with no actual line returns. Snippet of the output:"_formatted":"{\\r\\n \\"request\\" : [\\r\\n {\\r\\n \\"addDate\\" : \\"/Date(1449794160000-0600)/\\",......Connecting an Inspector to the to the formatter works as expected.I should mention that I am using the 2016.1 Beta version (for the Elasticsearch goodness it contains.)
Hi,Is there any option to read .plt files?Pratap
Hi all,I am calling a stored procedure in oracle. The procedure returns a "ref cursor" data type.When calling with SQL Developer I have this result:select bddoc_mgr.get_file_status_fme('w:\rwa005\energis\data\dwg\bp\geo','l144152-3.dwg') from dual{<FILE_ID=1,S_FILE_STATUS=2,S_STATUS=4,N_VERSION=1000,L_USERID=IAA543 >,}When calling with SQLCreator I have this error:Could not understand type information: type=116, size=8, scale=0, precision=0ORACLE Reader: Executing SQL Statement `select bddoc_mgr.get_file_status_fme('w:\rwa005\energis\data\dwg\bp\geo','l144152-3.dwg') from dual' to obtain features for feature type `QueryFactory_SQLExecute'Unable to define column number 1: error was `ORA-01024: invalid datatype in OCI call'. (serverType=`ORACLE8i', serverName=****, userName=****, password=`***', dbname=`')When calling with python I can parse the result easily:Is there a way to reach similar result using an SQLCreator?import fmeimport fmeobjectsimport cx_Oracle# Template Function
Hey everyone I wasn't sure where to post this as I thought it may be a bug.I'm running FME Desktop 2016.0.0.0 Build 16167 - WIN64I have a workbench that takes in multiple rasters, does some reclassifying and then some raster maths by adding them together.When it gets to the writing stage, the process fails with this error message: GEOTIFF writer: Failed to process a band with interpretation 'INT32' with the number of bits per cell set to '4'. The band bit depth must be the minimum value of (8, 16, 32) that is greater than or equal to the specified bits per cell. For example: to write 1-bit data the band interpretation should be 8-bit; to write 12-bit data the band interpretation should be 16-bit; to write 19-bit data the band interpretation should be 32-bitA fatal error has occurred. Check the logfile above for detailsI have gone into the advanced parameters of the geotiff writer and set the bits per cell to 32 but it still attempts to write at 4 bit.I think t
Hi,I have to convert dwg files to pdf in a batch mode, but it seems the paper size is restricted upto A3. Is there any option to increase the paper size.Pratap
Good day, everyone!I'm fairly new to FME (a couple of weeks of usage). I'm currently using FME 2015.1.Right now, I have a number of source Microstation V7 DGNs (from 2 different folders, which are being fed into a couple of DGN readers) that I'm feeding into a Clipper to clip them up into portions. I'm able to get the results (with a lot of help from a colleague). The issue I'm seeing so far:- Original DGNs, when the mouse hover over a, say, line, it says "Complex Chain \\ Line String" then "Level: 01_DUCT." But the resulting DGNs, the "Level" just says "60." I guess the "60" string is coming from the reader's Level Name field:- Original lines are DARK BLUE in colour, but resulting lines have some sort of a LIGHT PURPLE in colour.- Original arrow heads (for showing dimensions, I guess) are solid DARK BLUE. Whereas the resulting arrow heads are hollow.I have exposed the followings:- igds_glass- igds_color-
basically my title sums it up. I converted a file in arcsde postgres database to postgis database. Conversion ran succsesfully and I can access the file in postgis in QGIS, but when I tried to access the fila via ArcGIS I get the error: Error opening feature class DBMS table not found. Can anyone help?
We have a bunch of jobs running on FME Desktop, these jobs are run by windows scheduled tasks. However we are migrating to FMEServer and plan to schedule the jobs with the builtin scheduler. The problem is that in order for our outsourcing-partner to easily monitor these jobs it would be ideal if FME could write to the windows eventlog. Has anyone out there done this ? In know of a few cmd-line programs that can write to the eventlog calling them from a workbench is one way to go or are there better options ?
How to convert dwg files to kml.Tried to convert get ==============================================================================Total Features Written 0=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-KML: Writing dataset to filesystem...KML: Feature does not have a coordinate system specifiedStoring feature(s) to FME feature store file `.\\mapping_log.ffs'
There are two types of Esri Geodatabase writers for file geodatabase - "File Geodb API" and "File Geodb ArcObjects". Can anyone explain the difference and why I should use one over the other?,
Hi,In my workspace I have a featurereader that reads GeoTiff-files enclosed in ZIP-files. Subsequently I create a shape-file containing the bounding boxes of the GeoTiff-files and three attributes. The attributes bestand and lufo_jaar only contain values when I add an inspector to the featurereader. When I disable or remove the inspector, the attributes in the shape-file are empty. What is wrong with my workspace?I built the workspace using FME Desktop 2015.I'd really appreciate your help with this problem.Willy
Hello, I have an element which contains child elements but I only want to extract the text of the element ignoring all the child elements. Here is my example : <list_item> <paragraph>A wreck exists in position <location>America> </location> </paragraph> </list_item>What I would like to extract is A wreck exists in position. Usually I use the Attribute Exposer but in this case it is not workingbecause the closing tag of the paragraph is after the location.What transformer should I sue in this case?Thanks for you help.
I'm trying to post an idea, but I can't upload an image. Does anyone experience the same thing? Tried it on Mac and Windows, with Chrome and IE. Didn't matter: the upload bar never progresses.Strangely enough, it does work for Q&A; posts like this one:
Hi,If possible could someone answer these general Point Cloud Questions, apologies if they are obvious? 1. What does the PointCloudConsumer actually do? It is effectively acting as a valve which restricts the maximum number of points (as specified within the block size) being read in at any one time? If this is the case, then I assume it is used to ensure that the downstream workbench processes are not overwhelmed by the size of point cloud points? However, I assume that the block size means that the whole point cloud data will be read, but effectively it is read iteratively, rather than in a single hit. If it it not doing any of these things then what does it actually do?2. Does encoding a LAS file as a blob using the PointCloudExtractor pretty much only change the encoding; but not really ‘compress’ the data in terms of size. I have a LAS file which is about 18MB in its native format. I have read it into FME and then used the PointCloudExtractor to convert the file to a blob. I have
Hello,I want to attach all address-attributes (city, postalcode, street etc.) to my citygml-lod2-buidlings. And I want to add them in the right way (not as generic attribute). I know, I'll need a citygml-writer called "Address" beside my "Building", "RoofSurface" etc. and I'll need to point the gml_parent_id to the gml_id of the building.So how do I have to create/fill the attributes, so that the address is properly written to the citygml-dataset?
Hi All, I'm trying to import JSON into a postgres table which has a JSON column, Unfortunately I get an error of:PostgreSQL connection: Column 'data' has unknown type with OID 114, treating as char(80)Is there a way to increase the default past 80 characters? As the reason its failing to insert to postgres is the JSON isn't valid cause it gets truncated to 80 characters.
Hi.I am writing to a Microstation V8 DGN. I have used the DGNStyler transfomer to convert a series of points to cells, and now I want to set the color of the cells based on an attribute. However there doesn't seem to be the option in DGNStyler or in any of the igds format attributes to set the color of a cell.Any ideas?Thanks,
Hi,I have got citygml files. I need to extract the footprint of each building and the corresponding building id, such as:<bldg:Building gml:id="_26991">One building can have more than one footprint.I'm not very familiar with citygml / fme. Can someone give me a hint how to extract the footprints (which seems quite easy) but additionaly get the building id as well. It seems I need to access the "building" for the id and "footprint" for the footprint. But how do I get building - id for each footprint?Many Thanks, Rob
Would be grateful for some advice on this. FME is refusing to load any data from this WFS service. I can see the set of layers (get capabilities) from the service when I try to add the reader but when I select the data layer I need and hit ok the log is giving me the error below.This WFS service loads vectors just fine into Qgis but not FME. Any help would be appreciated.http://www2.guildford.gov.uk/ishare5.2.web/getows.... The top-level type definition referred to by the 'type' attribute in the element declaration is missing from the XML SchemaQName: 'ms:ogc_fid' | namespace uri:'http://mapserver.gis.umn.edu/mapserver'QName: 'Integer' | namespace uri:'http://www.w3.org/2001/XMLSchema'<element xmlns="http://www.w3.org/2001/XMLSchema" name="ogc_fid" type="Integer"/>
Good Day FME'ers,I have recently upgraded to FME 2016 and I have been testing all our production workspaces to make sure they run correctly. Some of our workspace write data out to CartoDB and they have all no started producing errors. The log record is as follows:2016-01-28 11:42:05| 17.1| 0.0|ERROR |CARTODB writer: HTTP Error 400-599: HTTP error code : 4002016-01-28 11:42:05| 17.1| 0.0|ERROR |CARTODB writer: Error returned by server : relation "{table_name}_cartodb_id_seq" does not existwhere {table_name} is the cartodb table.The data or table structure has not changed since upgrading and this did not occur in 2015.1. I'm not sure if it's a bug in FME or an issue with CartoDB. I could delete and recreate the tables in CartoDB but I would lose the styling.Any thoughts?Thanks,David McDermott
I have to transform various datasets in gml-files which have to have a certain structure (>xsd-schema-file). The gml-files get imported into a subsequent application which checks the structure and throws an error if something is missing.In my original data though, not all the featureclasses exist in all the datasets, and in the gml-files that are written, those featureclasses are not contained and I get errors afterwards.I would like FME to write all the featureclasses to the gml that are defined in the schemafile, so that if there is no data for a featureclass, the tags for this featureclass are written into the gml-File, but without data between them.There's a parameter for the GML-writer "Write all featureclasses", but the tags are still not written for missing featureclasses.(In the docs it says concerning this parameter: Every GML writer DEF line is translated to the output GML application schema document as an XML Schema element declaration and a corresponding
Im frequently receiving this warning that forces me to delete postgres or postgis readers and add the readers again. There are cases that forces me to always keep the workspace open otherwise i will need to re-ad readers and set again exposed params. Anyone else noticing similar thing with PG readers ? Thanks Jorge
Hi Guys,another question for an issue i never did in FME.... with which transformer i can do such operations before writing excel ? (screenshot substract)
Hello everyone!I am extremely new to FME Desktop (2011). I've been playing with it for the last few days. I am at a point where I would like to ask for your help! I would really appreciate all your suggestions/answers.Background:Currently, I'm trying to modify an existing workbench. This workbench grabs data from an Oracle database. The data goes through a series of transformers: Joiner -> AttributeClassifier -> 2DPointAdder -> ListExploder -> FeatureMerger (where another Oracle table is merged) -> ListExploder_2 -> FeatureMerger_2 (where a new CVS file, with 277K rows, is merged) -> ListExploder_3 -> AttributeFilter -> MapInfo TAB file.Current Situation:The above seems to be running okay for a small subset of data (1000 rows from Oracle).There is another CSV file (60+ rows of lookup data) that I would need to merge into the existing workbench. (Creating another table in the Oracle database might be a better solution for this lookup table. But
Why does TextPropertyExtractor expose no Attributes?