Arbital scrape

https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape

Update: Arbital Scrape V2 I’ve scraped http://​​arbital.com as the site is unusably slow and hard to search for me. The scrape is locally browsable and plain HTML save for MathJax. https://​​drive.google.com/​​open?id=1b7dKhOzfMpFwngAeI8efeOzv147Lv_mx https://​​emma-borhanian.github.io/​​arbital-scrape/​​ If there’s interest let me know as I may tidy up and open source my code. edit: working on this Mirror: www.obormot.net/​arbital

Comment

https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape?commentId=tyggTsR9sh8LGmEFz

This is now hosted at https://​​www.obormot.net/​​arbital/​​ .

Comment

https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape?commentId=PhDkEmmeoEsFjSA3X

FWIW, I think it’d be helpful if this link were edited into the OP to make viewing more obvious.

Comment

You may want to post a comment saying this as a top-level reply, so that emmab will be notified of it, yes?

Comment

Pretty sure he gets notified of all comments on his posts by default

Comment

Wait… really? I thought the notifications were just for top-level comments?? Is that false…?

Comment

I’m not actually sure and can’t check right now, but I thought so.

Comment

Yeah, notifications are for all comments, not just top-level.

Ok

https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape?commentId=vzgfGGX5TXhzbnwET

Thanks!

Comment

https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape?commentId=zgwpTEzsJbEoHg6zc

Follow up: wow, there’s a lot of good stuff here I hadn’t known about.

https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape?commentId=ZwvNmnAD8a5dH7Xhj

I’ve been working on something similar, it should be ready soon-ish.

Comment

https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape?commentId=yDgPwKyqRAWfPfPmr

I’ll wait to open source mine to see if yours is better then :)

Comment

Nvm. Arbital Scrape V2

https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape?commentId=tKgeneD2ZFZZxskEv

The scrape seems to be missing the Solomonoff induction dialogue, which was available at https://​​arbital.com/​​p/​​solomonoff_induction/​​?l=1hh (at the moment I just get an error).

ETA (2019-06-28): The new version of the scrape has this page, and can be viewed on the GreaterWrong version.

Comment

https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape?commentId=c3cX9nNS5ftDq6Gko

Seconded, that part is missing. Thanks for pointing out that very interesting dialogue.

https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape?commentId=wmMMxAmHSPLNp4oQs

Thanks very much for this! I’ve written a lot of stuff on there (I’m the Patrick Stevens whose name is splatted all over the screenshot). I asked them a year ago (ish) whether I could have a data dump, and they said it was Too Difficult; and I didn’t bother scraping it myself. I’m glad you actually went and did something about it!

https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape?commentId=RcJg8o4ochTBcw3eX

If there’s interest let me know as I may tidy up and open source my code.

Please do!

https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape?commentId=KfqdHC59jXkQX93MS

Nice project thanks. It’s also consistent with my analysis that Arbital’s fancy wiki features never added much value (say, more than +30%) beyond the value that that content would have if published in a pre-existing format and venue.

https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape?commentId=uenFCF6pFYDeWGZNS

This seems good. I remember Said being interested in hosting a static version of the site.

https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape?commentId=AoowgwaMbJo27MmfD

Just a reminder, the Solomonoff induction dialogue is still missing:

https://​​www.lesswrong.com/​​posts/​​muKEBrHhETwN6vp8J/​​arbital-scrape#tKgeneD2ZFZZxskEv

Comment

https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape?commentId=bGRh8B8yvEygRYcup

See Arbital Scrape V2

https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape?commentId=8fPaob6HPeAMSN2SJ

For the sake of us newbies, could you explain what the site was/​is?

Comment

https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape?commentId=yvhbH32jX2vA6SxWu

Arbital Postmortem is the first explanation I can think of.