 |
|
|
|
|
|
| |
| |
|
|
|
|
| |
| |
|
|
https://console.aws.amazon.com/ec2/help/spotrequests.html
I always thought that was a very realistic way of working things.
--
Darren New, San Diego CA, USA (PST)
Human nature dictates that toothpaste tubes spend
much longer being almost empty than almost full.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Darren New wrote:
> https://console.aws.amazon.com/ec2/help/spotrequests.html
>
> I always thought that was a very realistic way of working things.
Permutation City?
This is an interesting move. As I understand it, an Amazon "instance" is
like a virtual machine. So starting and stopping one is quite a lot of
work. Not sure what you'd use a VM that could shut down at any random
second for...
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Invisible wrote:
> Darren New wrote:
>> https://console.aws.amazon.com/ec2/help/spotrequests.html
>>
>> I always thought that was a very realistic way of working things.
>
> Permutation City?
Yep. In case my late-night comment was confusing (and it was), I meant I
thought Permutation City's fictional depiction of spot prices for
computation sounded very realistic, and here we are a few years later doing
just that.
> This is an interesting move. As I understand it, an Amazon "instance" is
> like a virtual machine. So starting and stopping one is quite a lot of
> work.
It takes a couple of minutes to do so, yes.
> Not sure what you'd use a VM that could shut down at any random
> second for...
Hook it to a persistent disk and render an animation? Restart from where you
left off? If each frame only takes a minute or two and you are rendering a
feature-length animation...
Extra responsiveness to read-mostly queries as long as it's cheap enough?
--
Darren New, San Diego CA, USA (PST)
Human nature dictates that toothpaste tubes spend
much longer being almost empty than almost full.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Darren New wrote:
>> Not sure what you'd use a VM that could shut down at any random second
>> for...
>
> Hook it to a persistent disk and render an animation? Restart from where
> you left off? If each frame only takes a minute or two and you are
> rendering a feature-length animation...
I guess it hadn't really registered that it's possible to make an
instance immediately start doing work as soon as it boots up. I was
thinking a VM that you're interactively working with isn't much use if
it's going to die any second...
Interestingly, the documentation for DevPay seems to indicate that I
could (for example) create an instance, install POV-Ray, and charge
people money to run this instance, and thereby earn money. I bet it
wouldn't actually work though.
--
http://blog.orphi.me.uk/
http://www.zazzle.com/MathematicalOrchid*
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Orchid XP v8 wrote:
> I guess it hadn't really registered that it's possible to make an
> instance immediately start doing work as soon as it boots up.
Yes. I have an instance that when it boots it looks to see if there's a
backup of the wiki files in S3, and if so it installs them. Then it starts
the wiki server. Every 10 minutes or so, if something has changed it copies
a backup back to S3. I still have to restart the instance by hand, because
they don't actually die unless I screw it up, but it's not hard to make a
rc.local that runs something.
> Interestingly, the documentation for DevPay seems to indicate that I
> could (for example) create an instance, install POV-Ray, and charge
> people money to run this instance, and thereby earn money. I bet it
> wouldn't actually work though.
I am not sure what "work" means here. It apparently has some troubles, but
not that much. I was thinking of making one to run my distributed job
computing software (aka OddJob), but I couldn't figure out all the places
where my S3 password was stored and such, so I didn't keep chasing it.
--
Darren New, San Diego CA, USA (PST)
Human nature dictates that toothpaste tubes spend
much longer being almost empty than almost full.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
>> I guess it hadn't really registered that it's possible to make an
>> instance immediately start doing work as soon as it boots up.
>
> Yes. It's not hard to make a rc.local that runs something.
...unless you run a Windows instance. ;-)
>> Interestingly, the documentation for DevPay seems to indicate that I
>> could (for example) create an instance, install POV-Ray, and charge
>> people money to run this instance, and thereby earn money. I bet it
>> wouldn't actually work though.
>
> I am not sure what "work" means here. It apparently has some troubles,
> but not that much. I was thinking of making one to run my distributed
> job computing software (aka OddJob), but I couldn't figure out all the
> places where my S3 password was stored and such, so I didn't keep
> chasing it.
I'm thinking more about the following:
1. No sane person is going to pay money to run POV-Ray on Amazon when
they could just run it locally on their own PC for free.
2. I have a vague recollection that attempting to do this contravines
the POV-Ray license.
3. If you *were* going to pay money for a POV-Ray rendering engine, you
wouldn't want to log in, start up a VM, copy all your files onto the
server, configure all of POV-Ray's options, set it running, and check it
three times a day to make sure it hasn't finished. (You'll still be
charged if you don't shut it down as soon as the render is done.)
What you'd *actually* want is a button in POV-Ray that says "submit to
server" and it grabs all the files, INI files, etc., zips them into a
big bundle, uploads it, adds it to the server render queue, and emails
you the result when it's finished or something.
As far as I can tell, it's not possible to do this. Or at least, it's
not possible to use DevPay to do this. You'd have to have an instance
running constantly, and you'd have to pay for it whether there's work to
do or not.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Invisible wrote:
> ...unless you run a Windows instance. ;-)
Then you use the Windows equivalent, which is a service.
> 1. No sane person is going to pay money to run POV-Ray on Amazon when
> they could just run it locally on their own PC for free.
Well, no, you have to do more than have just POV-Ray there. For example, you
could have a mechanism where the person sets up the configuration on their
own computer, clicks a button that launches 10 Amazon instances and
distributes frames to them and collects the results, then composes them into
a video when you're done, after shutting down the instances that were rendering.
> What you'd *actually* want is a button in POV-Ray that says "submit to
> server" and it grabs all the files, INI files, etc., zips them into a
> big bundle, uploads it, adds it to the server render queue, and emails
> you the result when it's finished or something.
Right.
> As far as I can tell, it's not possible to do this. Or at least, it's
> not possible to use DevPay to do this. You'd have to have an instance
> running constantly, and you'd have to pay for it whether there's work to
> do or not.
I don't understand why you'd say that. It works OK for me. I just never got
around to doing the button that launches the instance, altho having it read
the configuration and go from there works fine.
--
Darren New, San Diego CA, USA (PST)
Human nature dictates that toothpaste tubes spend
much longer being almost empty than almost full.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
>> ...unless you run a Windows instance. ;-)
>
> Then you use the Windows equivalent, which is a service.
Well, yeah, or whatever.
>> 1. No sane person is going to pay money to run POV-Ray on Amazon when
>> they could just run it locally on their own PC for free.
>
> Well, no, you have to do more than have just POV-Ray there.
Agreed.
>> As far as I can tell, it's not possible to do this. Or at least, it's
>> not possible to use DevPay to do this. You'd have to have an instance
>> running constantly, and you'd have to pay for it whether there's work
>> to do or not.
>
> I don't understand why you'd say that. It works OK for me.
As far as I can tell, DevPay lets you earn money for anything that's
just an AMI. If it isn't an AMI, but some application that *runs* an
instance as part of its operation, DevPay isn't applicable.
--
http://blog.orphi.me.uk/
http://www.zazzle.com/MathematicalOrchid*
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Orchid XP v8 wrote:
> As far as I can tell, DevPay lets you earn money for anything that's
> just an AMI. If it isn't an AMI, but some application that *runs* an
> instance as part of its operation, DevPay isn't applicable.
You'd have to launch the instance with your AMI, yes. You get paid for
people running your AMI.
--
Darren New, San Diego CA, USA (PST)
Human nature dictates that toothpaste tubes spend
much longer being almost empty than almost full.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
>> As far as I can tell, DevPay lets you earn money for anything that's
>> just an AMI. If it isn't an AMI, but some application that *runs* an
>> instance as part of its operation, DevPay isn't applicable.
>
> You'd have to launch the instance with your AMI, yes. You get paid for
> people running your AMI.
Granted I haven't read the detailed documentation. But it looks like you
can put together an AMI and list it on Amazon's website with "hey, you
can run this thing for $2/hour". But that would mean that to use your
AMI, somebody would have to select it, start it up, copy their files
onto it, launch POV-Ray and tell it to render.
If you wanted to be able to submit renders from your PC and have them
automatically run, you'd have to have an instance constantly running,
waiting for work to be submitted. Which means that when there's no work
in the queue, you're paying money for an idle instance to run. And even
when there is work, DevPay doesn't appear to offer a way to charge money
for submitting a job to a queue, only for physically starting an AMI.
Assuming I've understood the documentation correctly anyway...
Post a reply to this message
|
|
| |
| |
|
|
From: Mike Raiford
Subject: Re: One step closer to Permutation City
Date: 17 Dec 2009 08:52:46
Message: <4b2a37ae@news.povray.org>
|
|
|
| |
| |
|
|
On 12/16/2009 3:49 AM, Invisible wrote:
>
> I'm thinking more about the following:
>
> 1. No sane person is going to pay money to run POV-Ray on Amazon when
> they could just run it locally on their own PC for free.
Who knows. Depending on the price, paying for some seriously parallel
CPU time to get an animation done quickly may be worth it. Especially if
that animation were extremely complex with groundbreaking (at least in
the POV world) graphics, showing off what their favorite renderer would
do. I mean ... how could would it be to have a feature film done
entirely in POV? (Yes, It would be painful and arduous to do, but some
people like doing things "Just because")
> 2. I have a vague recollection that attempting to do this contravines
> the POV-Ray license.
Sure, you could charge someone to run a renderfarm using POV-Ray as a
renderer. You're charging for the compute time, not the program.
--
~Mike
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Invisible wrote:
> Granted I haven't read the detailed documentation. But it looks like you
> can put together an AMI and list it on Amazon's website with "hey, you
> can run this thing for $2/hour".
Yes. Which might be worthwhile if that's how you're selling software you
can't get anywhere else.
> If you wanted to be able to submit renders from your PC and have them
> automatically run, you'd have to have an instance constantly running,
> waiting for work to be submitted.
Huh? No. You start the AMI when you're ready to render something, and shut
it down when it's finished. That's the point.
If you're automating it (or, rather, the way *I* automated it), the software
on your desktop creates an S3 bucket with a name based on your Amazon ID, it
copies the files up to it, it launches the AMI passing in your credentials,
the AMI starts up and looks at the credentials and copies down the jobs,
renders them, and puts the result back on S3 and shuts down. When all the
instances have shut down, the software on your desktop copies the results
from S3 back to your machine.
--
Darren New, San Diego CA, USA (PST)
Human nature dictates that toothpaste tubes spend
much longer being almost empty than almost full.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
>> Granted I haven't read the detailed documentation. But it looks like
>> you can put together an AMI and list it on Amazon's website with "hey,
>> you can run this thing for $2/hour".
>
> Yes. Which might be worthwhile if that's how you're selling software you
> can't get anywhere else.
Indeed. It wouldn't surprise me if somebody like AutoCAD lets you run
their software this way so you can "rent" it rather than "buy" it.
(Although... why would you only need CAD software for a short while?)
>> If you wanted to be able to submit renders from your PC and have them
>> automatically run, you'd have to have an instance constantly running,
>> waiting for work to be submitted.
>
> Huh? No. You start the AMI when you're ready to render something, and
> shut it down when it's finished. That's the point.
>
> If you're automating it (or, rather, the way *I* automated it), the
> software on your desktop creates an S3 bucket with a name based on your
> Amazon ID, it copies the files up to it, it launches the AMI passing in
> your credentials, the AMI starts up and looks at the credentials and
> copies down the jobs, renders them, and puts the result back on S3 and
> shuts down. When all the instances have shut down, the software on your
> desktop copies the results from S3 back to your machine.
That sounds like a sensible workflow. And I guess if the AMI gets
started under the customer's account (which your tool presumably has to
somehow obtain), they get billed, and you can still take your cut.
...until somebody else realises that all your AMI actually does is untar
the files and launch POV-Ray, and they build their own AMI that does the
exact same thing. Now they can do exactly what they did before, but
without paying a cut to you. ;-)
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Invisible wrote:
> That sounds like a sensible workflow. And I guess if the AMI gets
> started under the customer's account (which your tool presumably has to
> somehow obtain)
It asks.
> they get billed, and you can still take your cut.
Yes.
> ...until somebody else realises that all your AMI actually does is untar
> the files and launch POV-Ray, and they build their own AMI that does the
> exact same thing. Now they can do exactly what they did before, but
> without paying a cut to you. ;-)
Except my tool does more than that. It pushes a bunch of individual jobs up
to S3, launches multiple AMIs which coordinate to copy down the sources, run
the jobs, copy the results back up, and starts on new jobs as each machine
comes free, shutting each down when no work remains. And they don't all have
to be POV-Ray.
But yeah, if all you're providing is a machine preconfigured with a free
program, it's going to be rough to get someone else to pay you to run it.
--
Darren New, San Diego CA, USA (PST)
Human nature dictates that toothpaste tubes spend
much longer being almost empty than almost full.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Darren New wrote:
> Except my tool does more than that. It pushes a bunch of individual jobs
> up to S3, launches multiple AMIs which coordinate to copy down the
> sources, run the jobs, copy the results back up, and starts on new jobs
> as each machine comes free, shutting each down when no work remains. And
> they don't all have to be POV-Ray.
...and where can I get this tool? :-}
> But yeah, if all you're providing is a machine preconfigured with a free
> program, it's going to be rough to get someone else to pay you to run it.
LOL! People have tried dumber things... ;-)
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Invisible wrote:
> Darren New wrote:
>
>> Except my tool does more than that. It pushes a bunch of individual
>> jobs up to S3, launches multiple AMIs which coordinate to copy down
>> the sources, run the jobs, copy the results back up, and starts on new
>> jobs as each machine comes free, shutting each down when no work
>> remains. And they don't all have to be POV-Ray.
>
> ...and where can I get this tool? :-}
The part that actually launches the VMs isn't finished yet, because I didn't
do the API work to interface to ECC as well as S3. But if you want to launch
your instances manually and fire up the program on launch, it should work.
You get it from me, but it'll have to wait until I have time to package it
up properly, if you actually want it.
--
Darren New, San Diego CA, USA (PST)
Human nature dictates that toothpaste tubes spend
much longer being almost empty than almost full.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
So, since you seem to know a bit about AWS, here's a few questions...
1. Can you access stuff stored in S3 using normal HTTP requests?
2. How do you upload stuff to S3? I mean, presumably there's a shiny
webpage for uploading individual files, but what if I wanted to upload
programmatically?
3. How does AWS authentication work?
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Invisible wrote:
> So, since you seem to know a bit about AWS, here's a few questions...
>
> 1. Can you access stuff stored in S3 using normal HTTP requests?
Yes.
> 2. How do you upload stuff to S3? I mean, presumably there's a shiny
> webpage for uploading individual files, but what if I wanted to upload
> programmatically?
You use a library, depending on what language you're using, or you implement
your own, which I did for Tcl. I use the S3 extension to firefox for
interactive stuff.
> 3. How does AWS authentication work?
Using HTTP with REST, you sign certain HTTP headers and the content checksum
(or something like that) with the secret key that Amazon gives you when you
sign up for an account. Which makes it almost REST.
Using HTTP with SOAP, you use the standard SOAP certificate stuff that's
built into decent SOAP libraries.
--
Darren New, San Diego CA, USA (PST)
Human nature dictates that toothpaste tubes spend
much longer being almost empty than almost full.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
>> So, since you seem to know a bit about AWS, here's a few questions...
>>
>> 1. Can you access stuff stored in S3 using normal HTTP requests?
>
> Yes.
OK. The documentation wasn't very clear about this...
>> 2. How do you upload stuff to S3? I mean, presumably there's a shiny
>> webpage for uploading individual files, but what if I wanted to upload
>> programmatically?
>
> You use a library, depending on what language you're using, or you
> implement your own.
I'd be in the latter group.
(There *is* actually a library already, but there's no documentation for
it, so...)
>> 3. How does AWS authentication work?
>
> Using HTTP with REST, you sign certain HTTP headers and the content
> checksum (or something like that) with the secret key that Amazon gives
> you when you sign up for an account. Which makes it almost REST.
>
> Using HTTP with SOAP, you use the standard SOAP certificate stuff that's
> built into decent SOAP libraries.
...right. So I actually need real crypto libraries to be able to use it?
Oh well, that's the end of that then.
--
http://blog.orphi.me.uk/
http://www.zazzle.com/MathematicalOrchid*
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Orchid XP v8 wrote:
> OK. The documentation wasn't very clear about this...
Uh, OK. It seemed really clear to me. :-) They even give you options for
giving people time-limited access to otherwise unreadable objects.
>> You use a library, depending on what language you're using, or you
>> implement your own.
>
> I'd be in the latter group.
There ya go, then. Read the specs. It's pretty straightforward.
> ...right. So I actually need real crypto libraries to be able to use it?
> Oh well, that's the end of that then.
I think you need an MD5 implementation, is all.
--
Darren New, San Diego CA, USA (PST)
Human nature dictates that toothpaste tubes spend
much longer being almost empty than almost full.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
>> OK. The documentation wasn't very clear about this...
>
> Uh, OK. It seemed really clear to me. :-) They even give you options
> for giving people time-limited access to otherwise unreadable objects.
Oh, I haven't read through all the low-level documentation, only the
summary pages.
>>> You use a library, depending on what language you're using, or you
>>> implement your own.
>>
>> I'd be in the latter group.
>
> There ya go, then. Read the specs. It's pretty straightforward.
...for somebody who doesn't yet understand what SOAP or REST are?
>> ...right. So I actually need real crypto libraries to be able to use
>> it? Oh well, that's the end of that then.
>
> I think you need an MD5 implementation, is all.
I actually wrote an MD5 implementation in Haskell. (The hardest part is
the padding. You must get this exactly right, and MD5 allows the
"message" to be an arbitrary number of bits - not necessarily a multiple
of eight, not necessarily non-zero!) I eventually got it to produce the
correct answer in every single case I tested.
You can see where this is going, can't you? Yes, I admit it: It's way,
way too slow to be remotely useful. Files that md5sum.exe can process in
a split second take several minutes. I haven't figured out why yet.
(Alternatively, there's a binding to the C implementation - which
presumably won't work on Windows. Probably not hard to pipe the data to
md5sum.exe tho... Hell, that is one of the *design goals* of the tool!)
--
http://blog.orphi.me.uk/
http://www.zazzle.com/MathematicalOrchid*
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Orchid XP v8 wrote:
> Oh, I haven't read through all the low-level documentation, only the
> summary pages.
I would have thought it's in there, but...
> ...for somebody who doesn't yet understand what SOAP or REST are?
REST is "use HTTP to get and put data".
> You can see where this is going, can't you? Yes, I admit it: It's way,
> way too slow to be remotely useful. Files that md5sum.exe can process in
> a split second take several minutes. I haven't figured out why yet.
I think you only *need* to sum some headers, but maybe it's the whole file.
I'm not sure I remember.
--
Darren New, San Diego CA, USA (PST)
Human nature dictates that toothpaste tubes spend
much longer being almost empty than almost full.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
>> Oh, I haven't read through all the low-level documentation, only the
>> summary pages.
>
> I would have thought it's in there, but...
So, if I stick a bunch of HTML pages on S3, I can basically host a website?
>> ...for somebody who doesn't yet understand what SOAP or REST are?
>
> REST is "use HTTP to get and put data".
So, you upload stuff by making HTTP PUT requests? (As originally
invisaged by Tim Burton?)
>> You can see where this is going, can't you? Yes, I admit it: It's way,
>> way too slow to be remotely useful. Files that md5sum.exe can process
>> in a split second take several minutes. I haven't figured out why yet.
>
> I think you only *need* to sum some headers, but maybe it's the whole
> file. I'm not sure I remember.
OK, well I'll go dig through the specs.
--
http://blog.orphi.me.uk/
http://www.zazzle.com/MathematicalOrchid*
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Orchid XP v8 wrote:
> So, if I stick a bunch of HTML pages on S3, I can basically host a website?
Yes. The only thing that doesn't work is
http://blahlbhalbha.com/
You'd actually have to go to http://blahblahb.com/index.html
> So, you upload stuff by making HTTP PUT requests? (As originally
> invisaged by Tim Burton?)
Yes. And delete stuff with HTTP DELETE.
--
Darren New, San Diego CA, USA (PST)
Human nature dictates that toothpaste tubes spend
much longer being almost empty than almost full.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
On Fri, 18 Dec 2009 13:53:56 -0800, Darren New wrote:
> Yes. And delete stuff with HTTP DELETE.
HTTP DELETE -R /
Whoops...
Jim
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Jim Henderson wrote:
> HTTP DELETE -R /
>
> Whoops...
I think WebDAV's "Depth" header would actually let you shoot yourself on the
foot just like that.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
On Sat, 19 Dec 2009 02:55:19 -0300, Nicolas Alvarez wrote:
> Jim Henderson wrote:
>> HTTP DELETE -R /
>>
>> Whoops...
>
> I think WebDAV's "Depth" header would actually let you shoot yourself on
> the foot just like that.
Doesn't surprise me. :-)
Jim
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
>> ...for somebody who doesn't yet understand what SOAP or REST are?
>
> REST is "use HTTP to get and put data".
>
>> You can see where this is going, can't you? Yes, I admit it: It's way,
>> way too slow to be remotely useful. Files that md5sum.exe can process
>> in a split second take several minutes. I haven't figured out why yet.
>
> I think you only *need* to sum some headers, but maybe it's the whole
> file. I'm not sure I remember.
Can you do this stuff using mget or some similar CLI tool?
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Invisible wrote:
> Can you do this stuff using mget or some similar CLI tool?
Obviously I actually meant wget. And it appears wget only supports
downloading, not uploading.
However, apparently libcurl also has a CLI tool simply named curl, and
this apparently supports making HTTP PUT requests...
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Invisible wrote:
> However, apparently libcurl also has a CLI tool simply named curl, and
> this apparently supports making HTTP PUT requests...
"The Amazon S3 REST API uses a custom HTTP scheme based on a keyed-HMAC
(Hash Message Authentication Code) for authentication."
Oh bugger.
So a custom authentication scheme that curl doesn't support then? :-P
"To authenticate a request, you first concatenate selected elements of
the request to form a string. You then use your AWS Secret Access Key to
calculate the HMAC of that string."
Hmm, great...
Oh, and it appears to use SHA-1 rather than MD5. I wonder if anybody has
binary implementations of SHA-1 that work on Windoze? *sigh*
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
On Mon, 21 Dec 2009 10:52:13 +0000, Invisible wrote:
> Oh, and it appears to use SHA-1 rather than MD5. I wonder if anybody has
> binary implementations of SHA-1 that work on Windoze? *sigh*
http://tinyurl.com/y9qwz2z
Jim
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Jim Henderson wrote:
> On Mon, 21 Dec 2009 10:52:13 +0000, Invisible wrote:
>
>> Oh, and it appears to use SHA-1 rather than MD5. I wonder if anybody has
>> binary implementations of SHA-1 that work on Windoze? *sigh*
>
> http://tinyurl.com/y9qwz2z
Apart from the very first link, these all appear to be dodgy shareware
products which try to charge you money for something as trivial as
computing a file hash.
Still, there's probably a GNU port of the requisit program. Or there's
the first link, which is from MS, so it might actually work.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
> "The Amazon S3 REST API uses a custom HTTP scheme based on a keyed-HMAC
> (Hash Message Authentication Code) for authentication."
>
> Oh bugger.
>
> So a custom authentication scheme that curl doesn't support then? :-P
I'm still trying to figure out why the hell they didn't use the
pre-existing, widely-standardised mechanism for authenticating HTTP
requests...
--
http://blog.orphi.me.uk/
http://www.zazzle.com/MathematicalOrchid*
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
On Wed, 23 Dec 2009 09:25:04 +0000, Invisible wrote:
> Apart from the very first link,
Bound to happen when you search the net for a program to do something.
Doesn't mean that searching is a bad idea.
> Still, there's probably a GNU port of the requisit program. Or there's
> the first link, which is from MS, so it might actually work.
In either case that could be true, and since you know the name of a
program that does do this, that would be an excellent place to start a
search from.
Jim
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Invisible wrote:
> Can you do this stuff using mget or some similar CLI tool?
You can fetch files that are public using all the normal tools. To upload,
you need a tool that you configure with your Amazon identity (for example).
There are, however, numerous such tools available, and probably CLI versions
as well.
--
Darren New, San Diego CA, USA (PST)
Human nature dictates that toothpaste tubes spend
much longer being almost empty than almost full.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Invisible wrote:
> "The Amazon S3 REST API uses a custom HTTP scheme based on a keyed-HMAC
> (Hash Message Authentication Code) for authentication."
>
> Oh bugger.
That's why I think even AWS isn't REST.
> Oh, and it appears to use SHA-1 rather than MD5. I wonder if anybody has
> binary implementations of SHA-1 that work on Windoze? *sigh*
Yes.
--
Darren New, San Diego CA, USA (PST)
Human nature dictates that toothpaste tubes spend
much longer being almost empty than almost full.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Darren New wrote:
> Invisible wrote:
>> "The Amazon S3 REST API uses a custom HTTP scheme based on a keyed-HMAC
>> (Hash Message Authentication Code) for authentication."
>>
>> Oh bugger.
>
> That's why I think even AWS isn't REST.
Sometimes I wish REST was a registered trademark (with a royalty-free
license to use it), so that Roy Fielding could sue people who call their
protocols 'REST' when they're not :)
You know, things like Facebook where you POST the method name and the
arguments to /restserver...
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
>> Can you do this stuff using mget or some similar CLI tool?
>
> You can fetch files that are public using all the normal tools. To
> upload, you need a tool that you configure with your Amazon identity
> (for example). There are, however, numerous such tools available, and
> probably CLI versions as well.
So far, the only thing I've found is a Perl script. And I have no
intension of installing Perl on a dozen Windows boxes just so I can
access AWS.
--
http://blog.orphi.me.uk/
http://www.zazzle.com/MathematicalOrchid*
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Orchid XP v8 wrote:
> So far, the only thing I've found is a Perl script. And I have no
> intension of installing Perl on a dozen Windows boxes just so I can
> access AWS.
You already have Tcl, right? My code is in teacup. I think it's just called
S3. <check> Yes, in Tcl, package require S3.
Documentation:
http://wiki.tcl.tk/17618
Oh, foo. I forgot they don't actually put the documentation there, for some
bizarre reason. They require you to submit documentation and unit tests, but
then they don't include it in the teacup system. So, the link to my bucket
is fixed there, and the docs should be in there.
--
Darren New, San Diego CA, USA (PST)
Human nature dictates that toothpaste tubes spend
much longer being almost empty than almost full.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
>> That's why I think even AWS isn't REST.
>
> Sometimes I wish REST was a registered trademark (with a royalty-free
> license to use it), so that Roy Fielding could sue people who call their
> protocols 'REST' when they're not :)
From what I could tell from Wikipedia, "REST" isn't even a specific
mechanism. It's a vague design style. It looks like you could claim that
almost *anything* is REST...
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
| |
|
|
Invisible wrote:
> From what I could tell from Wikipedia, "REST" isn't even a specific
> mechanism. It's a vague design style. It looks like you could claim that
> almost *anything* is REST...
Yes. It's also targeted at human-consumed multimedia. Basically, he's
actually saying "you should make your multimedia web pages be separate pages
so the URL changes, rather than being embedded javascript or FLASH." It
really has little or nothing to do with how you organize an actual
machine-to-machine communication.
--
Darren New, San Diego CA, USA (PST)
Human nature dictates that toothpaste tubes spend
much longer being almost empty than almost full.
Post a reply to this message
|
|
| |
| |
|
|
|
|
| |
