topbanner_forum
  *

avatar image

Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
  • Thursday April 18, 2024, 11:54 am
  • Proudly celebrating 15+ years online.
  • Donate now to become a lifetime supporting member of the site and get a non-expiring license key for all of our programs.
  • donate

Author Topic: excel tool - cloud or home base?  (Read 4961 times)

Steven Avery

  • Supporting Member
  • Joined in 2006
  • **
  • default avatar
  • Posts: 1,038
    • View Profile
    • Donate to Member
excel tool - cloud or home base?
« on: October 29, 2015, 06:26 PM »
Hi,

I have an unusual, important and mildly unique need that is probably best native to a spreadsheet app. (Although I always would consider a database or programming-macro tool alternative.)

This is an application that could be one person at a desk, or it may be shared.  If we share it, that would of course be one bonus of using a cloud app.  And Google Sheets would have an inside track since we are already sharing some stuff in Google Apps for Biz.

=============================

Looking around: here are some of the alternatives:

PC
Excel
LibreOffice Calc  (or Apache OpenOffice)

Cloud
Google Sheets
Excel Web Application
Zoho Sheets

=============================

THE PUZZLE

We have an unusual pricing method and problem.  The vendor who sends us prices can change his % markup.  And he does not tell us when he does, and he does not give us a download option.  The total number of items is about 200, it could go up if we could streamline the pricing, and about 50 of those have to be watched like a hawk.  At least once a week, since small changes can mean a real difference.  So, no matter what, we have to go into his web site, and extract current data out, one item at a time. (One item on its own page.)  Yes, we have requested some help from them finding an easier method, and will do so more in the future. At this time, it is as it is.

The spot where we put in our tiered prices is dependent on the vendor (that spot does have CSV import/export), so we have to do some manual checking of what is the current % and how does it compare.

To automate this we probably want to put the current two (actually three, a changing spot price is involved that can even change in the middle of the data input session) factors of the items from the difficult source into a spreadsheet (perhaps twice a week, we are in a volatile and sensitive market) and then have the spreadsheet calculate the % and tell us which %s are different than the last time we did this.  Then we would adjust those by hand.  The final adjustment could even potentially be programmed automatically, but that is not so important.

Without this automated, it takes too many hours per week, even for a skilled person who understands the whole thing.  Automated would still require some handwork, much less though.   Plus we want to keep the data from one review to the next, and also the archived history.

You can see that this may be a bit tricky for anybody other than an Excel Whiz. 

WHICH TOOL?

Does that mean I should use Excel (or LibreOffice Calcs) for stronger macros and stuff like that?  Will it be easier than the cloud?  I noticed that Google Calcs says they don't have macros but they do have some script language.  It sounds to me that it might be cumbersome to work that way.

Hmm.. thinking about it, it might be nice to put the data in a MYSQL type of database, if I could find the right tool for data entry and programming and printing. This would be like my Alpha5 or Filemaker or Access thoughts.

WHO? HOW?

If anybody is really skilled on this stuff, helping set it up might actually be a little remote gig. You can send me a msg.  I am a programmer-techie of sort, but my Excel background is minimal.

Should I just buckle down and learn some spreadsheet macro language?  Should I consider the old Alpha 5, Filemaker, Access alternatives to setting this up?  Or some other tool that can through up fields, take screen input, work with the data file and do calcs?  Should I just seek help?

Steven
« Last Edit: October 29, 2015, 06:44 PM by Steven Avery »

Ath

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 3,612
    • View Profile
    • Donate to Member
Re: excel tool - cloud or home base?
« Reply #1 on: October 30, 2015, 02:40 AM »
As your data is web-based, you'd be better off using a web-scraping tool to collect the data, instead of manually reading the numbers from your screen.

Steven Avery

  • Supporting Member
  • Joined in 2006
  • **
  • default avatar
  • Posts: 1,038
    • View Profile
    • Donate to Member
Re: excel tool - cloud or home base?
« Reply #2 on: October 30, 2015, 07:19 AM »
As your data is web-based, you'd be better off using a web-scraping tool to collect the data, instead of manually reading the numbers from your screen.

Yep, your right. Thanks.  Any tool you recommend?
.
I can see 3 possibilities.  Easy front end, do it all myself.  Some scripting, I learn the specifics.  Hire it out. Definitely i would prefer to do it myself in-house and if the tool cost a bit, that's ok.

Of course, I have to also up my spreadsheet savvy, once the data is available (there is a uniform SKU for linking) so that part of the question remains.

Steven
« Last Edit: October 30, 2015, 07:54 AM by Steven Avery »

Ath

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 3,612
    • View Profile
    • Donate to Member
Re: excel tool - cloud or home base?
« Reply #3 on: October 30, 2015, 10:02 AM »
Well, you could get the pages from the web using curl or wget, use xmlstarlet (in html-mode) to extract your data, and output that to csv format for further processing in Excel or another spreadsheet program. Then upload the resulting file to a shared webspace or Dropbox account to distribute as needed.
Wrap it all with cmd or shell scripting, optionally using Cygwin to have the power of bash-scripting on Windows, and you're in business.

Steven Avery

  • Supporting Member
  • Joined in 2006
  • **
  • default avatar
  • Posts: 1,038
    • View Profile
    • Donate to Member
Re: excel tool - cloud or home base?
« Reply #4 on: November 02, 2015, 08:32 AM »
Thanks, I hope to spend some time on this today.  And we don't mind paying for a solid program with a friendly front-end (without losing much functionality of a raw scripting language) if such a program exists. Or contracting for some of the expertise needed, especially if the skilled person has a helpful teaching us approach. 

If we can do this in one day instead of a week, at the moment that would be a super-big plus.  I'd explain the company dynamic to the skilled person.

I'll check my user msg box on this.

Ath

  • Supporting Member
  • Joined in 2006
  • **
  • Posts: 3,612
    • View Profile
    • Donate to Member
Re: excel tool - cloud or home base?
« Reply #5 on: November 02, 2015, 12:54 PM »
(I'm not available, for at least the next few weeks... :-[)

Steven Avery

  • Supporting Member
  • Joined in 2006
  • **
  • default avatar
  • Posts: 1,038
    • View Profile
    • Donate to Member
Re: excel tool - cloud or home base?
« Reply #6 on: November 05, 2015, 01:01 PM »
(I'm not available, for at least the next few weeks... :-[)
I'll know better early next week if we are plowing ahead.  Our web support company in Montana says this is in their bailiwick too.  I'll plan on giving a report here after the weekend.

Target

  • Honorary Member
  • Joined in 2006
  • **
  • Posts: 1,832
    • View Profile
    • Donate to Member
Re: excel tool - cloud or home base?
« Reply #7 on: November 05, 2015, 03:22 PM »
you do know that excel will import from a web page. 

Without knowing some more of the specifics its hard to say if this is useful or not, but worth considering