How not to redact documents

An article Election Exclusive: British Advisors to Kamala Harris Hope to "Kill Musk's Twitter" by 

Paul D. Thacker and Matt Taibbi has the following redacted image:

Gee, gosh and golly, it's an incorrectly redacted document! Let's have some fin. I mean, fun. I mean... you know what I mean!

Let's see if we can unmask the E-mails of the people involved.

Take a close look at the selected section from the image above. Look under the redaction block in the second (lowest) line. Notice the descenders?

The character immediately to the left of "child" is the @-sign, and the E-mail name ends with a descender. The person (unredacted) is listed as "Danielle Lilly".

Step 1, lets overlay the @-sign and see how much space is left. We need an @-sign in the same font, but there are several available in the image. Select->Copy->Paste Transparent

While placing the @-sign, notice that the descender of the character exactly matches the visible descender on the redacted block.

So far so good!

Notice the (unredacted) name is "Danielle Lilly", and the redacted E-mail has a descender ? Let's do the same operation with the text of the name in the document.  Select->Copy->Paste Transparent

Now E-mails are always listed lower case, so we can't paste the full "Lilly" name here, we'll have to duplicate one of the lowercase "l" letters instead. Be sure to keep the same spacing.

And finally, note that a lot of systems use first initial+last name. Let's add a lowercase "D"  (for Danielle) and see where that gets us.

The red line shows the beginning of the left margin, and note that this exactly lines up with the left margin of the "Email" header.

I think Danielle Lilly's E-mail address is "dlilly@childfund.org".

Let's try another. Looking a little further in the document:

Notice the redacted section doesn't quite cover the ascenders in the document. Notice also that the ascenders in the name are quite similar. Hmmm....

And there's just enough room for "jmillican" in the redacted box.

Also, note that the "j" has an ascender that goes up above the redaction box. Is that a problem?

Nope. It's there, faintly, in the original image:

Many of the redacted E-mails in the image can be deduced by looking at the ascenders and descenders of the incompletely redacted names.

I won't post the full redacted image, only note that many of the E-mails listed on the original image can be deduced from the incomplete redactions.

The psychological basis of inspiration

Elliot's recent article and the comments about inspiration had a lot of um... information and I thought I'd post some of the more concrete scientific findings.

If you're interested in being creative, if you're stuck on a problem and are looking for inspiration, the following background information and specific advice might help.

Your brain has a filter

Our lives are awash in sensory input, but only the valuable parts are presented to our conscious mind. If something is not relevant to one of our goals, the brain filters it out and considers it irrelevant.

Most people don't realize how powerful this filter is. If you haven't already done so, check out the monkey business illusion. Pause reading this post, check out the video, and continue below:

The illusion works because your brain is given a goal. While you are focused on the goal, your brain filters everything that doesn't apply to that goal.

Your brain is a goal seeking mechanism

Your brain is essentially a goal seeking mechanism. We're born with a few innate goals, but we also get to set new goals over the course of our life.

You set your goals by explicitly identifying them. The best way to do this (people have found) is to write them out longhand. Doing this activates several sensory pathways in the brain at the same time: while writing you are simultaneously controlling your hand to make the letters, reading the letters, sounding them out in your mind, and thinking about the concepts.

Inspiration advice #1: Set a clear goal

The biggest reason people don't get inspiration is that they don't set clear goals. If you want to start a new project using Neopixels on a costume for an upcoming convention - that's fairly explicit and your goal setting mechanism can latch onto it pretty easily. There are clear design pathways and choices to make, a time limit, and physical and probably budget limitations. The brain works well with specific goals.

On the other hand, if you're just casting about for something new to do, you'll have tremendous difficulty. Your brain doesn't know what to do and you'll wander around in a fog. You might even try a few things, but you'll find it very difficult to follow through with the process: without a clear goal at the start, your brain will eventually give up saying effectively "why bother"?

So if you want inspiration, the first thing you want to do is to set a goal that has value to you.

Inspiration advice #2: Enter the open mode

Having set a goal, for actual inspiration, you need to turn your brain's filter completely off. You need to get into the open mode.

The best introduction to the open mode I've found is this video by John Cleese. It's fairly long (40 minutes) and you can watch it at your leisure, but to summarize: you get into the open mode by avoiding external stimulation for longer than 30 minutes.

The best way to do this that I've found is to go for a walk where there are no people. Find a nice path in the woods, or a back residential street with no pedestrians and no traffic, or the track around the football field when no one else is there.

For this to work you need to have no distractions. Turn off your phone, don't listen to podcasts or music, and don't go where you're constantly passing people or being interrupted by traffic. Just a nice, leisurely walk for about an hour.

Your brain is constantly being primed by interruptions in your environment, and each priming sets off a little subroutine that makes your brain focus on the primed subject for a short while. You need time for these subjects to die down so that your brain isn't primed. This becomes the open mode that John Cleese talks about.

Radio Shack

The original article talks about Radio Shack providing inspiration for hackers, but I don't think this is quite the whole story.

I think what really happened is that people set some goals and had project requirements, then went to Radio Shack, and found components that fit the requirements.

How to be creative

(A response to Elliot's article about creativity.)

How to be creative

There is no single recipe for creativity, but they all seem to follow roughly the same technique.

The best intro to creativity I’ve found is this video by John Cleese. Being John Cleese it’s a fun video, but what he talks about is completely accurate and based on how our brain works and is backed by research:

For an in-depth look at creativity, check out the book “deep work” by Cal Newport. Among other points, he talks about how artistic and highly productive people have managed to set themselves up for productive output throughout history. For another viewpoint look up Brian Tracy’s lectures on “the superconscious mind”. Many other sources say pretty-much the same thing.

To summarize, at any one time your brain runs lots of competing little subroutines that are primed by what you encounter in the environment (see “priming” on Wikipedia) used to predict the immediate future, called “nexting”.

When you set yourself in an environment with no distractions, these subroutines run their course and eventually die down, leaving your mind clear to think deeply about something with no distractions. During this time, if you have set up a problem for your brain to think about, it will do exactly that… and eventually give insight into the problem.

The effect is real, and not something people usually experience or even know about. The experience is also highly pleasurable.

It takes about 1/2 hour of uninterrupted time to *begin* this state if you are practiced at it. The first time might take a person 60 minutes and the first time they might not even be able to do it at all. It takes a few sessions to get the feel of it and know what to expect and where to put your mind.

Anything that distracts you from the state will stop it completely, and it will take another 1/2 hour to get back into the mode. A phone call will do it, someone stopping by your office will do it, and checking twitter on your phone will do it. Any distraction will activate more subroutines in your head, and it takes time for these to die down again.

There’s a brain neurochemistry explanation for this which I won’t go into (it’s in Cal Newport’s book, IIRC).

Lots of famously productive people practice this technique, it’s the root of their creativity.

Difference from flow

Flow is a slightly different state. The flow state is where you are hyper focused and lose track of the sense of time, but it’s not specifically tied to creativity. If you are an expert in something you can get into flow and be highly productive by using your existing skills, but not necessarily creative.

Creativity is described as being in the “open” or “closed” state, online it’s called “systemic mode” and “heuristic mode” (cf. wikipedia).

A good distinction between flow and creativity is the target: if you have a task to complete (writing, coding, sewing, circuit design) you can get into flow and complete the task quickly and efficiently. At any point you always know what the next task is.

Being creative is the opposite: it’s where you *don’t* know what the next step is, you don’t have a ready-made solution, and you have to mull over possibilities.

If you can quiet your mind, and think through the issues, your brain will eventually pop up a creative solution seemingly at random.

It’s weird – you’re thinking through a problem with no obvious solution, and suddenly the answer pops into your head with no obvious prior reasoning.

That’s the open mode. It’s closely related to flow.

(Flow also has a neurochemistry explanation.)