dimanche 29 mai 2016

Whats the better approach in managing large repeating csv data in laravel?

I am adding a function to our existing Laravel application managing financial transaction related data. Each week we are getting the data in csv files using the below given predefined format. I am wondering which approach I should use to load that data into the database

  1. Should I load the csv data straight into a single table using same fields in the csv format? or;
  2. Should I split the table into originators, and destination?

e.g. csv format: transaction_id, date, Originator, origin_id, currency, amount, destination, destination_id,

This is especially important considering that in the end of the day, users will need to search for entities and their associations using an ID number or entity name

If it helps, we get millions of records in each csv file often with same individuals and entities repeating on either side of the transaction.

Thanks in advance :)



from Newest questions tagged laravel-5 - Stack Overflow http://ift.tt/1sjyXSO
via IFTTT

Aucun commentaire:

Enregistrer un commentaire