>> OK. The documentation wasn't very clear about this...
> 
> Uh, OK.  It seemed really clear to me. :-)  They even give you options 
> for giving people time-limited access to otherwise unreadable objects.

Oh, I haven't read through all the low-level documentation, only the 
summary pages.

>>> You use a library, depending on what language you're using, or you 
>>> implement your own.
>>
>> I'd be in the latter group.
> 
> There ya go, then. Read the specs. It's pretty straightforward.

...for somebody who doesn't yet understand what SOAP or REST are?

>> ...right. So I actually need real crypto libraries to be able to use 
>> it? Oh well, that's the end of that then.
> 
> I think you need an MD5 implementation, is all.

I actually wrote an MD5 implementation in Haskell. (The hardest part is 
the padding. You must get this exactly right, and MD5 allows the 
"message" to be an arbitrary number of bits - not necessarily a multiple 
of eight, not necessarily non-zero!) I eventually got it to produce the 
correct answer in every single case I tested.

You can see where this is going, can't you? Yes, I admit it: It's way, 
way too slow to be remotely useful. Files that md5sum.exe can process in 
a split second take several minutes. I haven't figured out why yet.

(Alternatively, there's a binding to the C implementation - which 
presumably won't work on Windows. Probably not hard to pipe the data to 
md5sum.exe tho... Hell, that is one of the *design goals* of the tool!)

-- 
http://blog.orphi.me.uk/
http://www.zazzle.com/MathematicalOrchid*

Post a reply to this message

Orchid XP v8 wrote:
> Oh, I haven't read through all the low-level documentation, only the 
> summary pages.

I would have thought it's in there, but...

> ...for somebody who doesn't yet understand what SOAP or REST are?

REST is "use HTTP to get and put data".

> You can see where this is going, can't you? Yes, I admit it: It's way, 
> way too slow to be remotely useful. Files that md5sum.exe can process in 
> a split second take several minutes. I haven't figured out why yet.

I think you only *need* to sum some headers, but maybe it's the whole file. 
I'm not sure I remember.

-- 
Darren New, San Diego CA, USA (PST)
   Human nature dictates that toothpaste tubes spend
   much longer being almost empty than almost full.

Post a reply to this message

>> Oh, I haven't read through all the low-level documentation, only the 
>> summary pages.
> 
> I would have thought it's in there, but...

So, if I stick a bunch of HTML pages on S3, I can basically host a website?

>> ...for somebody who doesn't yet understand what SOAP or REST are?
> 
> REST is "use HTTP to get and put data".

So, you upload stuff by making HTTP PUT requests? (As originally 
invisaged by Tim Burton?)

>> You can see where this is going, can't you? Yes, I admit it: It's way, 
>> way too slow to be remotely useful. Files that md5sum.exe can process 
>> in a split second take several minutes. I haven't figured out why yet.
> 
> I think you only *need* to sum some headers, but maybe it's the whole 
> file. I'm not sure I remember.

OK, well I'll go dig through the specs.

-- 
http://blog.orphi.me.uk/
http://www.zazzle.com/MathematicalOrchid*

Post a reply to this message

Orchid XP v8 wrote:
> So, if I stick a bunch of HTML pages on S3, I can basically host a website?

Yes. The only thing that doesn't work is
http://blahlbhalbha.com/

You'd actually have to go to http://blahblahb.com/index.html

> So, you upload stuff by making HTTP PUT requests? (As originally 
> invisaged by Tim Burton?)

Yes.  And delete stuff with HTTP DELETE.

-- 
Darren New, San Diego CA, USA (PST)
   Human nature dictates that toothpaste tubes spend
   much longer being almost empty than almost full.

Post a reply to this message

On Fri, 18 Dec 2009 13:53:56 -0800, Darren New wrote:

> Yes.  And delete stuff with HTTP DELETE.

HTTP DELETE -R /

Whoops...

Jim

Post a reply to this message

Jim Henderson wrote:
> HTTP DELETE -R /
> 
> Whoops...

I think WebDAV's "Depth" header would actually let you shoot yourself on the 
foot just like that.

Post a reply to this message

On Sat, 19 Dec 2009 02:55:19 -0300, Nicolas Alvarez wrote:

> Jim Henderson wrote:
>> HTTP DELETE -R /
>> 
>> Whoops...
> 
> I think WebDAV's "Depth" header would actually let you shoot yourself on
> the foot just like that.

Doesn't surprise me. :-)

Jim

Post a reply to this message

>> ...for somebody who doesn't yet understand what SOAP or REST are?
> 
> REST is "use HTTP to get and put data".
> 
>> You can see where this is going, can't you? Yes, I admit it: It's way, 
>> way too slow to be remotely useful. Files that md5sum.exe can process 
>> in a split second take several minutes. I haven't figured out why yet.
> 
> I think you only *need* to sum some headers, but maybe it's the whole 
> file. I'm not sure I remember.

Can you do this stuff using mget or some similar CLI tool?

Post a reply to this message

Invisible wrote:

> Can you do this stuff using mget or some similar CLI tool?

Obviously I actually meant wget. And it appears wget only supports 
downloading, not uploading.

However, apparently libcurl also has a CLI tool simply named curl, and 
this apparently supports making HTTP PUT requests...

Post a reply to this message

Invisible wrote:

> However, apparently libcurl also has a CLI tool simply named curl, and 
> this apparently supports making HTTP PUT requests...

"The Amazon S3 REST API uses a custom HTTP scheme based on a keyed-HMAC 
(Hash Message Authentication Code) for authentication."

Oh bugger.

So a custom authentication scheme that curl doesn't support then? :-P

"To authenticate a request, you first concatenate selected elements of 
the request to form a string. You then use your AWS Secret Access Key to 
calculate the HMAC of that string."

Hmm, great...

Oh, and it appears to use SHA-1 rather than MD5. I wonder if anybody has 
binary implementations of SHA-1 that work on Windoze? *sigh*

Post a reply to this message