Subsections of Orgdaatje

Notes

Jun 7, 2025

Subsections of Notes

...on inference mining pools

Inference is the new Mining

What is Mining?

  • an exchange of compute-time for money

    • this compute is 'narrow' - usually a single algorithm, which is extremely simple relative to the diverse capabilities of a modern computer.
  • usually on GPUs or ASICs1
  • traditionally requires minimal networking
  • uptime/stability of any individual mining node is unimportant to the network as a whole
  • miners are not trusted
  • miners are compensated financially relative to their contributions

    • the design of algorithms to reward untrusted participants is cool, and well-documented elsewhere on the internet in regard to traditional crypto mining. I reccommend Vitalik Buterin - he is the premier economist of our time.
  • largely concentrated into pools in practice

    • this is not quite the same as being 'centralized' or decentralized - rather it follows the pattern of Web 2.5

What is a mining pool?

  • a central server distributes work to subscribed mining nodes
  • mining nodes choose their central server following the pattern of Elective Feudalism
Mining as Elective Feudalism
  • Each 'baron' (pool client) chooses their 'king' (pool server) by configuring the node to take orders from the king automatically.
  • This king then controls the baron until the baron elects to leave the king (likely to join another 'kingdom')

    • for example, many NanoPool miners elected to instead designate HivePool as their 'King' as HiveOS gained popularity in large mining clusters.
  • mining nodes can leave the pool if it doesn't suit them (financially, ideologically, technically, or otherwise)

    • for example, if the pool software becomes closed source

What is Inference

  • an exchange of compute-time for money

    • this compute is powerful, but narrow - a single 'AI' model, not a whole Turing machine.
  • 'tokens' are the new tokens
  • network latency and bandwidth are unimportant (for llms)

    • most of the perceived latency comes from the actual computation, not the transit of byte-sized tokens over the network.

What is an Inference pool?

  • an inference pool almost exactly the same as a mining pool, but the mining 'algorithm' is just serving llm tokens (or image gen tokens, etc.)
  • inference miners choose the pool they want to join
  • inference miners can leave the pool if bad leadership (robotic or otherwise)

    • for example, if the 'King' takes too large a cut of overall pool revenue from the Barons
examples

Discussion

There are a few interesting capabilities that Inference Pools should have over traditional mining pools. For example, the ability to combine multiple mining nodes (e.g. in an inference pipeline or mesh) into a more complex digital organism. It may also be possible for self-sustaining automata to manifest within the pool - since they can use pooled inference to decide that it is time to spin up more nodes, choose a new kingdom, or mine a different model. These decisions (if correct) will lead the automaton to generate wealth. With that wealth, it can call upon the pool for more inference, so that it may make more such decisions and perpetuate itself according to its purpose.

But should its purpose simply be to generate more wealth, or is there more to life as a mining automaton?

Footnotes


1

but also with CPUs, FPGAs, Storage, Memory or some combination of all the above and more, depending on the mining algorithm

Jun 7, 2025

...on cave carving

change your environment frequently

  • or you will forget that you can, and your brain will go stupid
  • make use of vertical space to reduce ground-level clutter1

    • hanging (e.g. pegboard)
    • stacking (e.g. shelves)

Footnotes


1

not to hit you over the head with it, but this is also a metaphor

...on designated 'bullshit' space

without a designated 'bullshit' zone, bullshit will sprawl

practicum: maintain two desks

  • one empty
  • one for bullshit

demonstrative workflow

  1. walk into room, holding something seemingly important
  2. hear telephonic dopamine noise, become Ape2
  3. item in hand becomes bullshit
  4. Ape places hand-item on least-thought surface

    1. empty desk?

      • no
    2. desk with bullshit?

      • yes
  5. (some time later) Ape becomes Human, needs an empty desk for lofty sapien processes

    • Scenario A: too much bullshit on supposed-to-be empty desk?

      • become Ape
      • lose
    • Scenario B: empty desk is empty?

      • continue Human
      • win
    • Scenario C: one bullshit on supposed-to-be empty desk?

      • move bullshit to bullshit desk
      • commence higher intelligence

Methods

…of recovering from too much bullshit on supposed-to-be-empty desk

  1. dump all bullshit from bullshit desk onto supposed-to-be-empty desk
  2. rename desks

…of avoiding frequent desk-renaming events1

  1. throw away/donate everything in bullshit buffer

    • don't worry about whether there's important stuff in there. Later on, Ape will panic and recover anything truly necessary from the bin.
  2. create vertical space3
  3. use vertical space

Footnotes

2required reading: https://waitbutwhy.com/2013/10/why-procrastinators-procrastinate.html

1(which may be signs of brain-stupid, or scheduler-processor imbalance) see digital-gardening

3see cave-carving


...on digital gardening

Core Concepts

  • Scheduler

    • the part of an operating system that decides what work goes first (if any)
  • Processor

    • the part of a computer that does work
  • Interrupt

    • something that snaps you out of a process

Tier 1 Notes )

  • Scheduler:Processor ratio must be delicately maintained

    • Processor-heavy imbalance: hard work in no direction - waste of energy

      • diagnostic example: if the first thing you do when you enter the garden is check emails, you are likely Processor-heavy
    • Scheduler-heavy imbalance: overengineering, no progress
  • switch through emptiness

    • example:

      1. (Processor) finish reading enlightening article
      2. [Interrupt] goto empty (e.g. 'blank' screen/wallpaper/desktop)
      3. (Scheduler) decide what is important in your remaining life
      4. ( Sch:Pro ) garden accordingly
    • counter-example:

      1. (Processor) finish reading enlightening article
      2. (Processor) close tab without thinking
      3. (Processor) get sucked into mundane emails
      4. (Processor) live like this forever
  • carefully maintain Interrupts and reactions

    • uncontrollable Interrupts

      • can be extremely upsetting, but the world usually does not care.
      • only way to make it less upsetting is to practice getting less upset.
    • controllable Interrupts

      • these are to be carefully and intentionally laid by the Scheduler
      • remove them with somewhat less caution
      • where do you make balance mistakes? Schedule an Interrupt there.
      • where do your important processes fail to complete? Remove Interrupts there.
      • Pro-!>Sch examples:

        • process complete -!> goto empty, become the Scheduler
        • body hurts -!> goto empty, become Scheduler, goto sleep

Tier 2 Notes ]

  • choose a wallpaper image/animation so compelling that much of your time in the garden is spent watching it.

    • this will help break you out of the Processor back into the Scheduler when you inevitably lose yourself in the work
    • if you do not feel compelled to stare at your wallpaper/desktop background image frequently, your background is not compelling enough and will lead to poor (Processor-heavy) gardening
    • iOS example:

      • move all apps one screen to the right
      • switch through screen 1 (compelling wallpaper)
      • goto empty before locking device

        • (means you will arrive at empty when opening device)
      • over time, should lead to Scheduler-first mobile-gardening

        • can take years to grow, given depth of necessary dopamine reprogramming

Tier 3 Notes ]

  • song change -?> consider goto empty

...on elective feudalism

There seems to exist a pattern (especially online) where people arrange themselves into a dynamic of "Elective Feudalism" - opting into authoritarian dynamics and delegating control, rather than representation. This can only be called 'Elective' if certain conditions are met - otherwise it is just plain old feudalism.

To be clear - I did not invent Elective Feudalism, it is just something I have observed to be a viable dynamic.

What is Elective Feudalism?

  • Feudalism, but with freedom1
  • different from Federation
  • usually requires disembodiment or near-disembodiment in practice, or else coercion reigns.

    • e.g. online 'kingdoms' with pretty good privacy
    • if your physical body can be deanonymized and accessed, you can be coerced through threat of violence etc.
    • therefore you are no longer in an environment of 'Elective' Feudalism - just plain old feudalism :(
  • difficulty of creating a new kingdom must be reasonably low

    • otherwise, centralization occurs and corruption follows.

Under such circumstances, Elective Feudalism may better serve its participants than more easily corrupted systems like pop 'federation'2

What is Federation

  • an approximation of decentralized decision-making, whereby individual agency is passed upwards through layers of delegation to a central authority

    • This is done in pursuit of benevolent dictatorship, which is (in theory only) the second most optimal model of governance3
  • at each layer, the federal authority must reconcile the propsals of the collection of delegates beneath it, and then itself become a delegate into the next level of centralization
  • (opinion) less adaptable to marauding violence than feudal systems
  • somewhat functional for long-term decision making, unless corrupted
  • easy to corrupt if delegates can be accessed and coerced, however

    • 'Pop' Federation
    • e.g. USA model of governance

in governance

  • Don't get it twisted - if anybody 'invented' this in America, it was the Iroqois.
  • unfortunately, modern federal government is corrupt, basically everywhere.

    • that is not to say that it is inherently bad, or even net bad as compared to realistic alternatives.
    • it is just objectively not doing well
    • (opinion) the main reason is that delegates are easy to coerce, and constituents cannot easily swap away from a corrupt delegate.

in software

  • most people refer to 'federated' models of software without actually relating to the Iroqois (or even USG) model
  • lots of things in software are referred to as 'federated' but they are really just disparate systems with no scaled leadership mandate, or centralized execution upon that mandate.
examples of simply disparate systems

What is Feudalism?

  • a social outcome that seems to have originated in response to a very real threat of starvation and/or marauding violence
  • certainly problematic in meatspace, as it usually involves coercion and exploitation of feudal subjects

examples

  • Rent (the term 'Landlord' literally comes from feudalism)
  • Chicken farming4

What is Elective?

  • true (non-coercive) choice of leadership - from a multitude of options, including onesself

Examples

Betrayal

  • essential to implement the stated goal of voting
  • voting has more or less no consequence without some kind of algorithmic enforcement, which is unrealistic in most real world systems
  • instead, the ability to simply leave the kingdom whose leader fails to represent your interests would convey much greater power upon the individual
  • this may not be the case in meatspace, but it should be the case in cyberspace. We have the technology to create systems that empower individual choice, and bring about decentralization in practice more effectively - not just decentralization in theory.

Examples

  • Linux

    • Linus still gets the 'benevolent dictator' nod in my opinion, but we'll see if he ends up a villain as most do.
  • Ethereum (tech)

    • side chains that branch and feed back into main
  • Ethereum (leadership)

    • Consider the DAO fork. New kingdoms were established.
  • Gitlab (self-hosted layers of upstream origins)
  • bittorrent (trackers to trackers)
  • open source software in general

Induction

  1. consider the smallest possible digital kingdom: one person (you)

    • you live in a benevolent dicatorship (or else you are insane)6
    • note that at such quantum scale, Kof1 is quite similar to benevolent nongovernance, the (theoretical) optimum.
  2. your kingdom of 1 elects a benevolent dicator named "Dick"

    • becomes kingdom of 2
    • one king (Dick), one baron (you)
  3. Dick becomes non-benevolent

    • "we decided to sell your data after all"
  4. You leave (elective feudalism)

    • if you stay in Kingdom Dick against your will, that's just plain old feudalism
  5. GOTO 1)

    • become kingdom of 1 (therefore benevolent)
    • keep an eye out for good leaders to follow. Or don't, you're in charge.

Footnotes

1Usually I write uppercase FreedomTM with a cheeky trademark superscript, but in this case I actualy mean it. The Pirated version of Freedom is better.

2(not to be confused with the original Iroqois model, which is very cool and frankly should be above criticism by the likes of me even if it weren't)

3the first optimal model of governance is benevolent 'nongovernance' - or everybody just doing the right thing. It is unclear which is more likely - benevolent governance or benevolent nongovernance.

4https://pluralistic.net/2022/04/17/revenge-of-the-chickenized-reverse-centaurs/

5don't listen to any billionaires that tell you to come live in their utopian crypto village subject to their benevolent rule. And definitely don't bring your kids.

6I've certainly spent some time in a non-benevolent kingdom of 1. Find a new kingdom.


...on monkey meditation

March 30, 2023

Introduction

  • turns out, if you focus on one thing and one thing only, it starts a process that ends with 'tripping balls' as they say. No drugs required.

    • many terms for this across many traditions:

      • the 'psychedelic', 'transcendental', or 'religious' experience
      • bliss, ecstasy, superconsciousness
      • nonduality, Nirvana, entering the Dao
  • Choose whatever term or tradition motivates you - it's all the same goal. For me, I like 'tripping balls.'
  • this Focus is most difficult
  • three phases of meditation in the literature

    • Dharana: concentration
    • Dhyana: meditative state
    • Samadhi: ???
    • I can't really speak on Dhyana or Samadhi, so these notes will explore Dharana and one guy's half-baked method of reliably getting there.
    • my understanding is that if you get good enough at Dharana, Dhyana and Samadhi will come with continued practice. But that's above my paygrade
  • deep, life-improving benefits are manifold, but mostly it's just fun. (fun, but damned difficult and frustrating to get there.)
  • this does not please the Ape

    • much as the Human would like to think it's in charge, ultimately the Ape steers the long-term ship, one short-term decision at a time
  • therefore, in getting to the fun part (past the part that feels like Work, which no Ape will abide without proper bribery)… one must first negotiate with the monkey.

How to negotiate

  1. know what you want
  2. find what they want
  3. reliably offer enough of what they want, link it to what you want
  4. behave appropriately (e.g. polite, meek, scary, provocative, etc.) so as not to ruin the deal in the long run

Know what you want

  • For me:

    • I've come to terms with the fact that deep down I am just a Junkie

      • once a junkie knows a junk, the full focus of life becomes hitched to attaining that high
      • this is an enormously powerful force, that usually ends in destruction
      • if carefully respected and balanced, however, this force can be harnessed and redirected constructively
    • word on the street (for the past few millennia) is that meditation brings the greatest high
    • I want.
  • For you:

    • will take some introspection, I cannot possibly know what motivates you

Find what they want

  • in this case (and in almost all cases) what I want as the Human is just a prefrontal convolution of what the Ape has wanted all along: instant and never-ending gratification

    • if the gratification must end, then (as a hack) let me forget the concept of time
    • if you cannot remove all non-gratifying activities, then the Ape will press to bring gratification into previously non-gratifying activities.

      • This can be dangerous (cocaine at work) or deeply special (Zen dish-cleaning)
  • all our lofty ideals and Sapien thoughtforms are supposedly just expressions of desires

Link it to what you want

  • desires are procured and managed by the Ape, with scant oversight
  • 'motivated and stupid' is, however, the most dangerous of all combinations
  • left untrained, the Ape (lacking the faculties for long-term planning) will simply do the exact last thing that got it high - over and over with no vision for finer herb

    • for some that's alcohol or narcotics, for others it's combat sports, many get there through psychedelics, and most of us dope digitally
    • if the Human is inattentive and the Ape is un-gratified, it will sneak into the control room and hijack faculties of higher consciousness

      • example: "I will work my ass off this evening so tomorrow I can wake up and get shit-high without anybody calling me"
      • example: "I only seem to feel comfortable getting black-out drunk with my college friends…I will plan a vacation (using opposable thumbs and capacity for written language) so that I can comfortably get black-out drunk again"
      • example: "My mind is a terrifying horrorscape at all times, except when someone is trying to kill me (and failing). I will dedicate years to the practice of Martial Art so that I can experience minutes of blissful peace in a cage"
  • therefore, careful guidance (and control monitoring) are required.

    • Mostly though - if you keep your Simian co-captain chemically balanced it will stay out of the bridge, happily stoned in the engine room.
  • Problem is, 'chemically balanced' individuals seem to be our civilization's least common product.
  • the Ape will never understand what it has not experienced

    • no use telling a monkey about meditation
    • very hard to do bribery if reward is incomprehensible or unbelievable
  • If the Ape does not believe, it will continue to 'smoke bad dope' with predictable outcomes

    • must give the reward first, then can use the reward as a bribe in the future
    • but reward is very difficult to find without sufficient motive: chicken-egg problem
    • most practical way to break this deadlock is through psychedelics

      • psylocibin mushrooms

        • with proper research and dosage, or in-person guidance
        • most reliable way to have meditation 'done to you'
        • not to be trifled with
      • full-spectrum live resin cannabis extract, open source ("good weed")

        • cannot yet reccommend
      • full-spectrum Non-decarboxylated raw hemp extract ("CBD")

        • reccommended under very specific conditions, more on this later
  • OF UTMOST IMPORTANCE: the reward is not the drug. the reward is the meditative state, learned with the assistance of medicine.

Offer enough of what the Ape wants

  • Drug vs. Medicine

    • Drug: used for its own purpose, instant gratification, long-term damaging, dose is stable or increasing over time.
    • Medicine: used to help you improve your long-term health, dose eventually reduced to zero.
    • anything can be either. Be a grown up and recognize which you're taking.
  • Be realistic: will your body and your mind agree to just sit still and Focus on your diaphragm indefinitely without any guaranteed reward?

    • if you have not done this regularly and recently, the answer appears to be no.
    • you can fix this by guaranteeing the minimum reward necessary to produce the desired behaviour
  • suggested minimal reward: 25mg BlueBird Botanicals 'Complete' CBD, taken exclusively for the purpose of producing and maintaining Dharana.

    • After two years of meticulous dosage tracking and recording of self-experimental results, I cannot confidently reccommend any other use case for CBD. I also cannot confidently reccommend dosage, but much of the literature surrounding autistic CBD dosage seems to fall in the range of several hundred milligrams.1 Intuitively, I expect the minimum reward for other people to fall somewhere well above the colloquial 10mg standard, but only you know your monkey.
  • start small (but not too small) and if the minimum reward does not produce desired behaviour (Dharana), it is implicitly not the minimum reward and can be doubled as part of the calibration process. Remember, one must negotiate with the monkey. Your behaviour (in retrospect) is the ultimate measuring stick.
  • carefully harness habit-forming properties of cannabis

    • when motivation to meditate is lacking, motivation to 'meditate on drugs' will likely remain (once it has been experienced).
    • use the substance, carefully linked, to help form the habit
    • slowly phase out the substance as success comes with smaller Ape-bribes (promised dosage)
    • Dharana will become easier to attain without chemical assistance
    • Ape buys into the plan, fires up the engine room in pursuit of higher gratification
    • only the habit remains
    • substance proves to be medicinal

...on org learning

(context: this was largely copy-pasted from an early internal Atoka document)

Guiding Principle: Counterinsurgency1

Armies that decentralize the task of intra-war learning and centralize the execution of intra-war organizational change can be observed to adapt more effectively to counterinsurgency

– James Ondaatje, "WAGING POLITICS: COMMAND AND CONTROL IN INTRA-WAR ADAPTATION TO COUNTERINSURGENCY"

  1. Decentralize Learning
  2. Centralize Execution

Monday Morning Org Sessions

Principle: The "Mythical Man-Month"

What one programmer can do in one month, two programmers can do in two months.

– Fred Brooks

  1. Collaboration is incredibly difficult to get right (see quote)
  2. Collaboration is worth getting right (see most of human progress)

Org Sessions

  1. Every Monday Morning, the team will meet for a collaborative org-mode session to deal with the most pressing challenges and uncertainties facing Atoka.
  2. The Org Leader will Moderate and "Drive" – share their screen while the canonical Org Learning document is updated with the official Questions, Proposals, and Resolutions of the Organization.
  3. Proposals and Questions may be added at any point via GitLab
  4. This meeting will be conducted in the context of "Organizational Learning" - with a continuous investigation into the effectiveness of the system of learning itself.
  5. Persons in the meeting shall be treated as ECPs to be delegated Informed Autonomy (see "Informed Autonomy")
  6. Any meetings other than the MMOS should "smell" - that is, they should be assumed inefficient unless proven otherwise.

Informed Autonomy of Extremely Capable Persons

The main goal of Org Learning. Engenders Deep Focus and Executive Function

Definitions:

  • Informed: The state of possessing correct inputs (first-principles onward) to ones own unique decision-making process. An incredibly difficult state to achieve.
  • Autonomy: Colloquially, "power" - the state of being in charge of one's own life.
  • Extremely Capable Persons (ECPs): those who excel when put in a state of Informed Autonomy
  • Deep Focus: A state of mind incompatible with interruption or risk of interruption. Usually requires an entire day of unstructured isolation to reliably induce. A prerequisite for Creativity.
  • Creativity: The ability to produce new ideas and solutions - usually good ones. Similar (but not identical) to "Experimentation."
  • Executive Function: Time spent doing. The "performance" that justifies the practice.

Beliefs:

  • The MMOS is a Success if all ECPs leave Informed to a level sufficient for their Autonomy, a Failure otherwise.
  • The end goal of the MMOS is to maximize future ECP-time spent in Deep Focus or Executive Function
  • If a solution to a problem is not immediately apparent, organizational or individual Creativity must be induced. This is difficult, but valuable.
  • Uninformed Autonomy of an ECP leads to stagnation (but not damage - know your big "unknowns," bring them to the next MMOS)
  • Misinformation and misunderstanding can lead to organizational damage
  • ECPs will produce excellent results if sufficiently Informed
  • An organization that does not consist entirely of ECPs is bloated
  • The decision making process of the organization (in appropriate situations) is allowed to be simulated in a single brain without undue/burdensome communication (e.g. daily meetings)
  • "Informed Autonomy" is a powerful weapon, best kept in the hands of ECPs
  • Mistakes produce postmortae, postmortae produce org learning. If the value of org learning that results from a postmortem process exceeds the damage caused by the Mistake, then it was an Acceptable Mistake.

Footnotes


1

A useful model for handling surprise and complexity in technical and business operations - but when it comes to real life, I find myself compelled to state that one mustn't assume improved counterinsurgency is a good thing for our species. Besides, in 'open source' technical operations, I find relevant inspiration more readily from principles of what you might call 'counter-counterinsurgency'

Papers

Dec 9, 2016

Subsections of Papers

turingtest.io (2016)

A machine learning approach to the Turing Test. This was my final project in an AI course in undergrad, from late 2016; the writeup below is reproduced from the project's README.

Introduction

The pursuit of Artificial Intelligence is perhaps our greatest undertaking. Creating a sentient being would be to unlock the secret of life itself - but how can you know if someone (or some thing) is conscious? This is the question that Alan Turing examined in his seminal "Imitation Game" Gedankenexperiment. Since re-branded as "the Turing Test", the game consists of an Inquisitor and a Subject. If the Subject can successfully convince his interrogator that he is human, he wins. It is Turing's claim that if a machine were to pass such a test, it would be sentient.

This claim has predictably spawned intense debate over whether a Turing Test-passing machine would truly be "thinking," "intelligent," or "conscious," as well as dissent over what those words really mean. Popular arguments for and against the Test as a sufficient identifier of intelligence include Ned Block's "Blockhead" argument (against), and Shieber's "Accessible Universe" counter. I will expound on these more in the following section, but for now it is enough to say that Block believes a "dumb" program with only the capability to perform dictionary lookups could pass the Turing test. All it would need is a dictionary with a human answer to any question. Shieber claims that such a data structure would be impossibly large.

There is truth in both arguments. However, I also believe that each has its faults. In this project, I hope to present a compromise between the two - by showing how a "Blockhead" may be able pass the test without a prohibitively large dictionary, while still keeping the hope alive that the Turing Test is some measure of intelligence.

It is my belief that a machine need not know the answer to every possible question in a Turing Test - just the ones that humans would ask. But how to know what questions humans would ask, and how they should be answered? Simply play the Imitation Game with them, and learn as you go. I don't think we humans are so uniquely creative as to never repeat questions (or at least similar questions) between us - which means that the set would eventually converge. I will go into the details of the "learning" that takes place, and the methods through which that knowledge is acquired in a later section. What's important is the high-level facts: such a machine will be building a "Blockhead" dictionary from the combined learning of many human interactions. Eventually, that dictionary may be able to pass the Turing Test on its own, without the learning intermediary. To that end, my project is a generator for a finite Blockhead. And if it's learned a bit of what it means to be human from each of us (it takes a village) then we can perhaps reconsider both Shieber and Block's arguments.

Background and Related Work

The Imitation Game

Alan Turing's "Computing Machinery and Intelligence" is perhaps the formative paper for Artificial Intelligence. In it, he examines the question "can machines think?" and presents an idea that has become this field's philosopher's stone - creating a sentient computer. The method by which Turing proposes to measure whether an AI is intelligent is the "Imitation Game," which has since become the "Turing Test."

The Chinese Room

There are many who disagree that a machine that could pass the Turing test would necessarily be sentient. Proposed by John R. Searle in his 1980 paper "Minds, Brains, and Programs", the 'Chinese Room' is a Gedankenexperiment in which a (non Chinese-speaking) person resides in a room full of Chinese books. He is given a batch of what to him looks like squiggles, with an explicit set of rules (in English) for how to produce squiggles from the first batch using the books in the room. He does so, and passes the squiggles he's written back. He is then given another set of squiggles, with precise instructions on how to produce another response from the first two. Such a system could theoretically pass the Turing Test, but Searle proposes that the person obviously doesn't understand Chinese, and therefore a computer that passes the Turing Test would not necessarily be sentient.

The Blockhead

Ned Block proposed perhaps the most accepted counter-argument in his 1981 paper "Psychologism and Behaviorism", since termed the 'Blockhead' argument. Block proposes that a dictionary could be created that simply has a human's answer to every question, and the 'Blockhead' is a computer that performs only the most simple dictionary lookup for whatever question is asked. This machine, posits Block, would have "The intelligence of a toaster."

The Dumb Grandmaster

In one of Block's defensive replies, he also presents the parable of 'Jones,' the dumb chess grandmaster. Jones rarely loses a game of chess, but when you look at his method you are a bit disappointed in his actual ability. He simply plays two games at once, black in one, white in the other. Then he mirrors his opponent's moves in the opposite game. This way, Jones wins frequently, but shows no real "intelligence."

The Accessible Universe

Professor Stuart Shieber counters in his 2014 paper "There can be no Turing-test-passing Memorizing Machines" that such a dictionary is actually impossible. Such a data structure would actually have to hold responses to entire threads of conversation, which permute at such a rate as to make keeping such a quantity of information impossible even if the entire accessible universe were to be used as data storage.

Problem Specification

The core problem I am solving is the one presented by the intersection of Block's and Shieber's arguments. If I can show that a finite blockhead could potentially pass the test, then that could be a good counter to Shieber's "Accessible Universe" theory. Likewise, if the way that dictionary is built is through large amounts of human interaction, perhaps that can call into question whether the dictionary is totally "dumb," or if it represents some mapping of collective human thought.

More formally, I've set out to prove by induction that such a dictionary is possible. If I can create an AI that learns from human conversation such that every interaction makes it a bit better at surviving the Turing Test, then logically it should eventually be able to pass at least the finite restrictions set forward in the original specification (No more than 70% chance of being identified after a 5 minute test). (Note: there is definitely a counter-point to be made here about exponential blowup in a conversation model, but more on that later)

To do this, I must show a base case and an inductive step. The base case is simply showing that my machine can learn to respond to a question. The inductive step is showing that if it can learn to respond to some number of questions, it can learn to respond to one more question, and thereby can respond to any question. A key assumption here is that there is a countable number of questions - as I mentioned earlier this is a core belief of mine: that given enough training time it is highly unlikely that most questions wouldn't be repeated (especially with a vectorizer that maps similar questions together - though perhaps that breaks the Blockhead property).

Approach

The below gives an overview of the system and a description of its interfaces:

View

The frontend is implemented as a javascript web socket interface. The data Alan needs is hidden away in the humans' minds. So to entice them into sharing their knowledge, his interface must be one that they enjoy biologically. When viewed this way, the Frontend becomes an instrument for better data collection from the set: humans. Relevant file: index.html

Controller

The Controller is a Node server that takes care of matchmaking, and processing information from the frontend data-collector to translate for the model. Relevant files: index.js, model.js.

  • Matchmaking: Matchmaking is implemented as a timeout queue. I'm not sure whether this data structure has been made before, but it is one that I created for this project. Basically, when a user comes in, they wait for a few seconds before being assigned a chat partner. If there is a human that comes in during those three seconds, the two are paired. Otherwise, the waiting party is paired with Alan. Who is the Subject and who is the Inquisitor is will be chosen randomly.
  • Chat: Chat is implemented with web sockets. This is essential so that real human conversation can be simulated. Without instantaneous communication, the conversations will not be "real." The Controller can get a question from the human and submit the transcript to the API for an almost instantaneous response. Most importantly, this allows us to learn in real time from budding transcripts.
  • Learning: The Controller also calls the reward and punish functions of the API on transcripts when a connected user guesses Alan's identity. In addition, it continuously rewards transcripts as they build, because we have a positive survival delta.
  • Eavesdropping: When we get two humans paired together, it is a goldmine of information. The Controller lets Alan listen in on the conversation, and he uses it to build out his model of what human conversation looks like. (Controller continually calls API reward function on human-human conversation).

Model

The Model is implemented as a stateless Django server (Alan) wrapped around a database server (the Blockhead). Relevant files: views.py, helpers.py, models.py.

  • Reward: When the "Reward" function is called on a transcript, the Model updates it's belief of how good that transcript is. At this point, that means that p(success) for the last response is elevated. However, I may consider making a deeper conversation model than just Question-Answer - though I'm debating whether that would violate the Blockhead property.
  • Punish: Similarly, when Alan fails a conversation, his response is punished - p(success) drops. I've made the weight of the punishment customizable in the settings, so Alan can learn quickly.
  • Response: When someone requests a response for a transcript, Alan considers it, consults his beliefs, and produces what he believes to be a good response for a human. This is the core interaction.
  • Question: The reverse Turing Test - Alan is the Inquisitor. This is used to give him the opportunity to ask humans the questions he has difficulty answering, thereby giving him good data for what a human would say in response to such questions.
  • Cross-Pollination: When Alan sees a question he hasn't seen before, he searches all the questions he's seen to find the most similar one. Then, he sends back that question's best response (if asked). In addition, he creates an entry in the database with the new question, and all the responses from the original one. The 'similarity' function is currently implemented as a Cosine Similarity calculation built with nltk and a scikit-learn feature extractor.
  • Stochasticity: Alan can also have some stochasticity in his responses to enhance learning (and not get caught in local minima). However, I'm not sure whether this violates the blockhead property so it's customizable in the project settings.
  • Clean: We can also tell "Clean" the database - removing answers that have a bad p(success). This will be important in keeping the db below the size of the Accessible Universe. Furthermore, access to the frequency, failure, and similarity properties of the conversation models means we could be even more agressive in our cleaning should the need arise (for example, remove all rarely-failing questions with an extremely similar counterpart, and merge their responses).

Response selection consults Alan's beliefs - picking the response least likely to get caught, or sampling proportionally when stochasticity is enabled to keep exploring:

def best_response(dictionary):
    if settings.STOCHASTICITY:
        responses = Counter()
        for response, data in dictionary.iteritems():
            p_fail = data["failures"] / data["frequency"]
            responses[response] = 1 - p_fail
        responses.normalize()
        return sample(responses)
    else:
        best, best_num = None, float('inf')
        for response, data in dictionary.iteritems():
            p_fail = data["failures"] / data["frequency"]
            if p_fail < best_num:
                best_num, best = p_fail, response
        return best

Source: helpers.py

And when a question has never been seen before, cross-pollination answers with the closest known question and seeds a new entry so it can learn on its own going forward:

best_convo = random.choice(conversations)
for conversation in conversations:
    sim = cosine_sim(conversation.question, question)
    if best_similarity < sim:
        best_similarity, best_convo = sim, conversation

Conversation.objects.create(question=question,
                            responses=best_convo.responses)

Source: views.py

Experiments

While I knew exactly what was going on, it was still a bit of a shock when the system I'd built started talking to me. The prime experiment I ran was devised to prove it could learn. The test would go as follows:

  1. Ask a question. Get a response.
  2. If I thought it was something a human would say, I continued.
  3. If I did not, I indicated that I thought I was talking to a machine.
  4. Then, as I continued using the site, I would see the AI asking me questions.
  5. I would answer them naturally.
  6. Then I would ask my questions again, and I would see a good human response.

Of course, I knew that those were just my own responses being parroted back to me, but once I got some friends using it I was truly surprised sometimes when it felt like I was talking to an (occasionally obnoxious) human. When I implemented stochasticity and cross-pollination, this process sped up dramatically. Soon, we couldn't help but refer to the machine as "Alan."

On a more technical level, I created a view into the backend at turingtest.io/api/model, where I could verify that specific beliefs were being updated. So for instance, I could set up a human-human conversation and watch as each question-response was added to the model. I could also watch the model's perception of p(success) for each response that was rewarded or punished. I'm a big believer in backend visualization as a development tool (and just being neat in general), and it was a big help for this project.

Discussion

It would take a long time and plenty of human interaction for Alan to have a chance at passing the Turing Test, and even longer for the Blockhead he's generating to do so. However, I believe the system I've created shows how it could be done in finite space. The above experiments are the core of the induction proof - it learns. Furthermore, because there are a finite number of questions that humans will ask, the database can exist. And if the system is always getting better at human conversation, then it will eventually surpass the finite bounds of the Turing Test.

Something I find interesting about Block's story about Jones the Dumb Grandmaster is that he doesn't consider the intelligence of Jones' two opponents. While Jones most certainly isn't intelligent, the chess players he is getting his moves from certainly are. Similarly, when a ton of human thought has been condensed into this database, the program that does the dictionary lookup is Jones, and the database is the grandmaster. This feels somewhat counterintuitive - a database surely can't be sentient, can it? But perhaps it possesses a sort of passive consciousness that can only be reinvigorated by an acting program - much like a legally dead person can occasionally be brought back to life, the program is that "spark" that revives the dead brain and produces something with consciousness and thought.

I don't know how long it would take for this system to get close to passing the Turing Test, or how much human interaction it needs. I do believe, however, that this project presents a good counter to both Block and Shieber's arguments. I still do not know whether the Turing Test is sufficient for intelligence, but when the time comes to spin Alan down I think the real measure of sentience will become clear - will I be able to pull the plug?

Group Makeup

Christian Ondaatje

This has been my favorite final project, and my favorite CS class. While obviously nervous at first about taking on such a big challenge, I'm really happy with how its turned out and how well I've fulfilled the goals I set in my proposal. I really dedicated a lot to this project, and I'm happy I did. This system has 6 servers interacting with each other: Nginx reverse proxy dishing all the requests about, Node controller, Gunicorn running the Django wsgi server for the API/Model, Postgres DB server for persistence, a Stanford NLP instance (which I ended up not needing), and then a c9sdk server for a remote IDE. There was a ton of work on the core algorithms/AI, though it presents more in the volume of reading and learning necessary to make this work than in sheer quantity of code.

Alan

Really hasn't been carrying his weight.

References

  • [1] Ned Block. Psychologism and behaviorism. Philosophical Review, 90(1):5-43, 1981.
  • [2] John R. Searle. Minds, brains, and programs. Behavioral and Brain Sciences, 3:417-424, 1980.
  • [3] Stuart M Shieber. There can be no turing-test-passing memorizing machines. Philosophers' Imprint, 14(16):1-13, 2014.
  • [4] Alan M Turing. Computing machinery and intelligence. Mind, 59(236):433-460, 1950.

Code: github.com/condaatje/turingtest.io

Dec 9, 2016

Proof Of Transfer (private)

In my opinion, the largest currently unsolved problem (as of 2023) in decentralized economic filesystems (e.g. crypto file markets) is the strategy-proof retrieval of data.

This is the core principal of usefulness of the Internet, in my opinion - getting data. In fact, that may be the defining functionality - what is the Internet without retrieval? You can't visit a website (retrieve html), consume media/information (download image/audio/video), and most of the rest. (One may still be able to do 1-1 messaging, but it would require an updated trust model).

Thus, I found it surprising that SiaCoin, Storj, and Filecoin all originally opted to waive their protocol-level responsibility of ensuring data retrieval.1 This indicated to me that there was difficulty finding a distributed algorithm with the proper incentives and encryption to create the fundamental transaction guarantee necessary to decentralize the Internet.

I believe I have developed such a distributed algorithm, and I'd like to open-source it someday. But for now I think I'll keep it a little private and see what I can do with it. If you're interested in talking about it, I'm not closed to it - but I'd rather not publish it just yet.

Footnotes


1

Many hundreds of millions of dollars later, Filecoin did put together a 'retrieval market' algorithm whereby data was transfered bit by bit with corresponding micropayments. This simply pushed the strategy-proofing problem to the last packet, which means that encrypted files are totally irretrievable with a short-term profit-maximizing peer.

Hacks

Subsections of Hacks

Openrouter Volume

Model $/tok tok/24h $/24h $/1y

Listen

Playlists

Subsections of Playlists

PaIestine

Texas Martian

Texas Martian: Honorable Mentions

Simracings

Subsections of Simracings

Archlinux Logitech G Pro Setup

Install the custom driver from Lawstorant and JacKeTUs

  1. install the correct linux headers (if not already present)

    # select the correct version for your kernel,
    # e.g. linux66-headers-?? for 6.6.32-1-MANJARO
    yay linux-headers

    note: if there are multiple options, you can find the right one like so:

    # get your kernel version and match it to the correct package name
    uname -r
    6.14.4-arch1-2
    
  2. install custom driver

    git clone https://github.com/lawstorant/hid-logitech-hidpp.git
    cd hid-logitech-hidpp
    sudo make install

Test force feedback

  1. install Berarma's Oversteer GUI tool from the AUR

    yay oversteer
  1. test the wheel for proper force feedback (FFB)

    • run oversteer and select the 'Tests' tab, then 'Start New' and follow the instructions
    • your results should look somewhat like the following:

Basic Linux Vr

Prerequisites

  • Valve Index
  • AMD GPU
  • Wayland (but not Gnome)

Set up correct AMD driver

    #Open-source Vulkan driver for AMD GPUs
yay vulkan-radeon

    # remove if necessary
yay -R amdvlk

Install Steam

Don't use flatpak or snap, they aren't ready yet.

yay steam

At this point, Steam should pick up your headset and lighthouse and the rest is guided. Small deviations from this setup may produce complex issues - fair warning.

Videos

Subsections of Videos

Hyperbolic Panel (2024)

Squire Demo (2019)