Bizzare question about importing a CSV file

M

MicS

Well-Known Member
Joined
Oct 23, 2009
Messages
274
Reaction score
2
Location
Gauteng
Hi guys,

I'd like some expert advice, though I'm not sure if this is the right section to post this thread.

Okay, so you may think this is a bizarre and ridiculous question to ask, because it may be technically impossible to so, but I'm giving it a shot anyway. Keep in mind I have very limited knowledge with computers and software.

I'd like to import a CSV file from an on-line website, but I want it to be done in a synchronised fashion.

Normally I wait until midnight, and then I manually import the CSV file. But I no longer wish to do this anymore. I'd like to go to bed earlier, so I was wondering if there was a way to import the CSV file automatically. Perhaps I could leave my internet connection and computer on, and at midnight I'd like the contents of the CSV file to be automatically retrieved, to be saved into either a txt or excel file on my hard drive.

Yeah, it sounds technically impossible, doesn't it? :wtf: :erm: I suppose some kind of programme or application would need to be developed for such a thing.

Any input is appreciated, even if this thread is actually useless. Thanks.
 
If you can predict what the filename will be, shouldnt be too hard. Most scripting languages should allow you to pull down the file and then do something with it. Your computer and internet connection would both need to be on though.
 
Okay, if I have the filename what would I need to do? I am a complete novice.
 
What platform are you working on?
OS:
DB:
 
How much do you know about IT and programming languages? Doing this would require decent knowledge of both. So, you would either need to start learning these things by doing a lot of reading, or pay someone to do it for you.
 
@Ancalagon: I guess then I am out of my depth here cos I have absolutely no knowledge of programming language, basic or otherwise.

@Nod: I don't know if this will help because I don't know anything about programming.
OS : Windows 7
DB : I assume you mean database. I don't know :confused: The CSV file is online. I don't really know if it comes from a database. Nothing is mentioned.
 
I cant think of an easy way to do it, BUT Microsoft Excel might just be able to help. I remember that it can import data from different data sources, including the Web. And, if I remember correctly, you can set it to auto refresh at certain intervals (I think). If you cant, you can write a vb script that will (again, programming though). Excel is probably your best bet.

EDIT: That is to say, MS Excel is probably the easiest way of doing it, using programming languages would be considerably harder.
 
Last edited:
@Ancalagon: Thanks for your assistance. I will give it a shot.

I was browsing the web last night, and I came across a CVS Importer/file converter. It's a software product that takes the CVS file and displays the information in an excel format. It's only a trial version. Still need to try it out though, but you can set it at specific times to import the CVS file. If you want to buy this programme it costs a truck load of money, which I'm not going to do. I don't know, if perphaps you know of any similar software that I can buy at a decent price, that is if my attempts at your suggestion fail (plus also I would need to learn programming from scratch). Should I ask in the Software section of MyBroadband if anyone knows of such software?

And where would start if I wanted to learn about programming?

Thanks.
 
MicS said:
@Ancalagon: I guess then I am out of my depth here cos I have absolutely no knowledge of programming language, basic or otherwise.

@Nod: I don't know if this will help because I don't know anything about programming.
OS : Windows 7
DB : I assume you mean database. I don't know :confused: The CSV file is online. I don't really know if it comes from a database. Nothing is mentioned.
Click to expand...

I see. Do you import the CSV file into a database, or do you just process it with excel?

If you simply open it with excel, you could simply paste the URL to the csv file into the open file dialog in excel.
If you want to automate the download, you have a few options depending on your skill level.
With freedownloadmanager you can schedule a download, and then process the file the next morning.
 
@remybfg10k : I assume this is another possibility, but I don't have Microsoft Access. If this option could work I could buy it.

@Nod : No I don't use any database. I process it with excel. Thanks for your suggestion - I will give it a try.

If all my attempts fail does anybody know of any software? Any file converters/CVS Importers?
 
Hi

Il go with nod, if you do not want to program or set up something from scratch. Provided you dont mind processing the file the next morning.

1. install freedownloadmanager
2. set it up to download the csv file at the prescribed time
3. leave your internet connection online

Btw what operating system are you using?

Regards
Bruce
 
BruceWayne said:
Hi

Il go with nod, if you do not want to program or set up something from scratch. Provided you dont mind processing the file the next morning.

1. install freedownloadmanager
2. set it up to download the csv file at the prescribed time
3. leave your internet connection online

Btw what operating system are you using?

Regards
Bruce
Click to expand...

I use Windows 7. Yes, I have already got free download manager.

Thanks for your input.
 
Personally, depending on what type of data it is, I would import the csv into MySQL (or some other DB), and then process it from there.
But, without know what data it is, and what you do with it, it is difficult to recommend a perfect solution.

I've done the following previously on a Linux box (everything automated):
1. Download .xls file from website
2. Convert it to csv
3. Import into MySQL
4. Have PHP frontend to draw pretty pictures with Chartdirector / jpgraph.
 
The CSV file is just a simple file containing dates, and other numerical data. All the data is numerical. What I usually do is import the file, and then I copy and paste it into a plain txt file. Then I add the data from the txt file into a pre-configured excel chart.
 
What I would do...

Most panels (cpanel, plesk, helm) support scheduled tasks. If the file you are downloading is from a straight URL I would write a few line script which will pull said file and email it to you once done. It would be really simple do do. If you have access to the crontab (on linux hosting, it runs scheduled tasks) I would just add the little script to it.
 
If you don't want to program, get someone to write you a script that uses FTP or hTTP to retrieve the file and stick it as a scheduled task in Windows?
 
I have attempted some of the suggestions. I've experimented with Excel again. You need some kind of Database or SQL of some sort, and I don't know how to proceed with that.

I also tried downloading the CSV file using Free Download Manager, but the URL for the CVS file doesn't actually allow for the file to be downloaded. I don't know what's the reason for this, but you actually have to open the file manually. Once this is done you need to click another button for the information to be processed (probably from some kind of database), and then it is displayed on a clipboard. The information consists of real-time statistics. Maybe that could be reason why the file is undownloadable.

Because the file is not downloadable, probably none of the suggestions will work. I don't know.

But not to worry. I thought of some alternatives, and decided to search Google. I thought that maybe I could use an auto-clicker with some kind of add-on to copy and paste the content of the CSV file to either a txt or an excel chart. Eventually I came across some automated software, called Workspace Macro. I have downloaded the trial version and it works like a charm! To purchase the full version it costs about $24.95-$44.95 depending on which version you purchase. No knowledge of programming is required. In S.A. does it cost an arm and leg to get someone to write a script for you? I wouldn't know the costs involved. Plus, learning programming language, while it is not impossible, it does takes up a lot of time and effort. If anyone's interested, here's the link: Workspace Macro.
 
You must log in or register to reply here.
Back
Top
Sign up to the MyBroadband newsletter
X