Bob Schwartz

AI Writes: Talk to Transformer

Artificial Intelligence (AI) won’t replace writers. No machine can ride the emotional roller coaster that writing can be, and what computer could consume the inappropriate volume of coffee (or alcohol) it takes sometimes to string words together? I mean, where would you pour it?

But then…

The Verge:

Even the most advanced chatbots can’t hold a decent conversation, but AI systems are definitely getting better at generating the written word. A new web app provides ample proof, letting anyone enter a text prompt to which AI software will automatically respond.

Enter the start of a made-up news article, and it’ll finish it for you. Ask it a question (by formatting your input like this: “Q: What should I do today?”), and it’ll happily respond.

The site is called TalkToTransformer.com, and it’s the creation of Canadian engineer Adam King. King made the site, but the underlying technology comes from research lab OpenAI. Earlier this year, OpenAI unveiled its new AI language system, GPT-2, and TalkToTransformer is a slimmed-down, accessible version of that same technology, which has been made accessible only to select scientists and journalists in the past. (The name “transformer” refers to the type of neural network used by GPT-2 and other systems.)

If you want to learn about AI language generation, there’s no better way to understand its huge potential and serious limitations than by playing around with TalkToTransformer.

On the plus side, the model is incredibly flexible. It’s able to recognize a huge variety of inputs, from news articles and stories to song lyrics, poems, recipes, code, and HTML. It can even identify familiar characters from franchises like Harry Potter and The Lord of the Rings.

At the same time, you’ll soon see that, at a fundamental level, the system doesn’t understand language or the world at large. The text it generates has surface-level coherence but no long-term structure. When it writes stories, for example, characters appear and disappear at random, with no consistency in their needs or actions. When it generates dialogue, conversations drift aimlessly from topic to topic. If it gets more than a few responses, it seems like good luck, not skill.

Still, as The Verge explained in our original coverage of GPT-2, this system is hugely impressive. Remember: this is a single algorithm that has learned to generate text by studying a huge dataset scraped from the web and other sources. It learned by looking for patterns in this information, and the result is a surprisingly multitalented system.

It may not be hard to find gaps in GPT-2’s knowledge, but it’s impossible to know whether you’ve explored the limits of what it can do.

Putting Talk to Transformer to the test, I prompted it with some of the most famous opening lines from classic novels (shown in bold). Note that for the sake of space, I have not included the actual opening paragraphs for comparison, author v. machine. If you’re not familiar with the real thing, you can easily look it up.


Jane Austen, Pride and Prejudice:

It is a truth universally acknowledged, that a single man in possession of a good fortune, must be in want of a wife. But no one would speak of him as a beggar. He has nothing that may entitle him to such a wife; and therefore it lies open to him, as to a man of ill estate, and who does not have any means, that he might marry his daughter, to whom his fortune might furnish a dowry—a woman who bore his child. So that, in other respects, the poor man is so fortunate in life as almost to be the chief benefactor of his country, without the necessity of making a comparison of his wealth with his want of property. But he has no reason to make such an comparison. For without it his property may grow to become much greater than the property of the richest in the family, whom it is not fit to receive any assistance from. So that no one will be willing, by any means, to enter into a marriage-contract with any one who is rich enough to support him. But if the property of any one whom he is bound to support can be reduced to…


Charles Dickens, A Tale of Two Cities:

It was the best of times, it was the worst of times, it was the age of wisdom, it was the age of foolishness, it was the epoch of belief, it was the epoch of incredulity, it was the season of Light, it was the season of Darkness, it was the spring of hope, it was the winter of despair.

It is possible that the old prophets who would write in our days, the last of them we are not able to remember, would go mad during the coming of the Age of Light, but only among us, for now all is still the same to them.

The world, or at least that part of the world, which is not dominated by the forces of light and sound, becomes a desert of blind blindness, which has its origin in the lack of knowledge in the human brain. The old prophets said that all of us who have knowledge of God must, sooner or later, fall into an abject state of ignorance about the reality of Things. However, those who are the more ignorant, have never the slightest fear of the Age of Light, as there is…


James Joyce, Ulysses:

Stately, plump Buck Mulligan came from the stairhead, bearing a bowl of lather on which a mirror and a razor lay crossed.  He had a large brown dog with blue eyes in his mouth, about twelve feet long.

“We are in the presence of the gods,” he said with a tone like a dog barking. As I walked inside, I glanced through the mirror which had the words “THE GODS” stamped upon it .  I recognized the face that stood behind the mirror and the voice of the god.  The god, whose name was Ouroboros, the One who is above and beyond, asked him if it was his name.  The dwarf replied that his name was “Buck”.   The god asked Buck Mulligan how he liked to be called.  Buck answered, “Well, in order to be called what we are, we must be named. I like it when you call me that way.”   The god had been talking about the god with his eyes shining and he felt something in his chest.
“I need a shave,” said Buck,…


Albert Camus, The Stranger:

Mother died today.  I’m sure she has a daughter too.  I’ve been trying to get her to talk to me for years.  I tried to give her a name, to remind her what her life was worth, to show a smile to tell her I love her and that she is special.  But, I couldn’t talk to her much.  She just was.  I’m not sure even if I could talk to her on the phone that would be enough to help her out.  Not a real good idea because, the moment she does meet someone, she will feel abandoned and so will almost any adult.   The last time I talked to her was before she passed away.  She was sick.  I saw her one last time in one of her many hospitals in the hospital.  She didn’t talk very often.  She seemed okay, at least when I had her.  She told me she was sorry she didn’t talk to me sooner.  I asked her about her kids, she said she was not home for the kids…


J.R.R. Tolkien, The Hobbit

In a hole in the ground there lived a hobbit. Not a nasty, dirty, wet hole, filled with the ends of worms and an oozy smell, nor yet a dry, bare, sandy hole with nothing in it to sit down on or to eat: it was a hobbit-hole, and that means comfort. If the hobbit was happy, it was also easy to look upon him. Why, that hobbit could do whatever he liked, and so he came often and went noisily and noisily of one to another to meet his needs, but the poor hobbit felt nothing and never had anything to feel for. How can a hobbit feel for someone else? It is hard for him to have the confidence that someone else would feel for him.

Then when the hobbit is very tired and doesn’t know what to do, how he feels for somebody is also not easy to come in contact with him if he is far from civilization; there is so little contact with a non-European. The one time the hobbit fell very sick he looked back in vain for all his friends and nobody would tell…


 

The Surprising Boost You Get From Strangers

I say, “Please don’t talk to strangers, baby”
But she always do
She say, “I’ll talk to strangers if I want to
‘Cause I’m a stranger, too”
Randy Newman, Have You Seen My Baby?

Elizabeth Bernstein writes in the Wall Street Journal:

The Surprising Boost You Get From Strangers
Sometimes a stranger—not a friend or a loved one—can significantly improve our day, providing comfort or helping to broaden our perspective

Sometimes a stranger—not a friend or a loved one—can significantly improve our day. A pleasant encounter with someone we don’t know, even a nonverbal one, can soothe us when no one else is around. It may get us out of our own head—a proven mood booster—and help broaden our perspective.

“People feel more connected when they talk to strangers, like they are part of something bigger,” says Gillian Sandstrom, a psychologist and senior lecturer in the Department of Psychology at the University of Essex, in Colchester, England, who studies interactions between strangers.

In research studies, Dr. Sandstrom has shown that people’s moods improve after they have a conversation with a Starbucks barista or a volunteer at the Tate Modern art museum in London. She’s also found that people are happier on days when they have more interactions with acquaintances they don’t know well and that students enjoy class more when they interact with their classmates.

And yet most people resist talking to strangers, she says. They fret about the mechanics of the conversation—how to start, maintain or stop it. They think they will blather on and disclose too much—or not talk enough. They worry they will bore the other person.

They’re typically wrong. Dr. Sandstrom’s research shows people underestimate how much another person will like them when they talk for the first time. And in a study in which she asked participants to talk to at least one stranger a day for five days, 99% said they found at least one of the conversations pleasantly surprising, 82% said they learned something from one of the strangers, 43% exchanged contact information, and 40% had communicated with one of the strangers again, an indication they might be making friends.

Scientists believe there may be an ancient reason why humans enjoy interacting with strangers. To survive as a species, we need to mate outside our own gene pool, so we may have evolved to have both the social skills and the motivation to interact with people who are not in our tribe.

You don’t even have to talk to complete strangers to reap the benefits. Multiple studies show that people who interact regularly with passing acquaintances, or who engage with others through community groups, religious gatherings or volunteer opportunities, have better emotional and physical health and live longer than people who do not. The researchers believe that engaging with someone we don’t know well is more cognitively challenging than interacting with loved ones: Rather than use the verbal shorthand that develops in close relationships, we have to speak in full sentences, engaging more of our brain.

Why do we enjoy talking to people we don’t know? An encounter with a stranger, when pleasant, fulfills four basic human needs, according to Rachel Kazez, a licensed clinical social worker in Chicago, who advises her patients to talk to strangers when they are feeling low. It gives us a sense of control, because we can choose whether to talk or not, and how much information we disclose.

We feel connected—it can sometimes be easier to open up and have an intimate conversation with a stranger because we know we won’t see that person again. We get to feel capable, because they don’t know our insecurities or setbacks. And the encounter may give us a sense of meaning or purpose, especially because a stranger doesn’t have to be nice to us.

“If you are feeling lonely and have a nice interaction with a stranger on a bus, you can suddenly feel like: ‘Oh, I fit in. I’m part of this city,’ ” Ms. Kazez says.

Poem on fire

Poem on fire

this poem had more words
but like logs on fire
it consumed itself

©

The Trump Economy: One-Third of Middle Class Can’t Afford $400 Surprise Expense, Federal Reserve Board Finds

Trump wants credit for the current U.S. economy, which he claims to have single-handedly made great. Despite broad and imprecise indicators such as GDP, unemployment rate and the stock market, the truth is that the economy is fragile for many—and not helped by the craziest and most undisciplined economic leadership in modern American history.

Here is one more sign of just how fragile.

Wall Street Journal:

One-Third of Middle Class Can’t Afford $400 Surprise Expense, Fed Finds
Many U.S. adults remain in position of ‘financial fragility’ despite ‘marginally’ improved economic security, central banker says

By Lalita Clozel
May 10, 2019

WASHINGTON—One-third of middle-class American adults couldn’t afford a $400 surprise expense, and some 6% also couldn’t manage such a cost even by borrowing money or selling something, a soon-to-publish Federal Reserve survey of household economics is expected to conclude. The middle class was defined as households with between $40,000 and $85,000 in annual income in 2018.

Fed Gov. Lael Brainard said in a speech Friday that the Fed’s 2018 Survey of Household Economics and Decisionmaking, expected to be released later this month, would show that while economic security has been “marginally” improving, many U.S. citizens—both in- and outside the middle class—were still in a position of “financial fragility.”

Americans’ widespread inability to shoulder an emergency expense “is something that is very pronounced in recent years, and we should be taking a hard look at it,” Ms. Brainard said. “It’s still a pretty large percentage of our respondents who find it difficult…to meet what may seem like relatively manageable expenses.”

Financial security is “one important marker of middle-class living standards,” Ms. Brainard added, speaking at a Fed community development conference. “Wealth is a very important source of resilience, allowing households to handle unexpected expenses to manage the usual changes in income over a lifetime.”

Many people in the middle class rely on credit cards to cover unexpected costs, Ms. Brainard said. Nearly 3 in 10 middle-income adults carry a credit-card balance most or all of the time, the Fed governor said. Those households are five times as likely to borrow if faced with a $400 expense as those who never carry a balance, she added.

Would you rather live in a democracy where many of your positions are not policy or would you rather live in an autocracy where you get most of what you want and ask for?

Do you want a government that gives you what you want most of the time? Or do you want a government that because of democratic principles sometimes—maybe often—goes against your wishes?

Lawful democracy doesn’t always go your way. But if you find an authoritarian who almost always agrees with your position, would that really be so bad?

Apparently in America right now, a substantial number want to get their way, and are willing to lean authoritarian, even if the democratic rule of law suffers. Americans have virtually no experience with this, and certainly not at the highest federal level. The worst case scenarios that seemed to some mere paranoid concerns are becoming even worse realities. There are supposed to be correcting mechanism available, but we suddenly see that those mechanisms take time, and more importantly, depend on the good will of those working the machines. Good will, prudence and integrity that we are discovering may be missing.

To those who love history, the saving grace is that you are getting to live through singularly historic times. To those who are young enough to see another generation or two, you will be able to tell your children and grandchildren that you were around when an all-time constitutional clash—the battle for American democracy—took place. Let’s hope you will be allowed to tell the whole story, and that you will be believed and not dismissed as the purveyor of fake history.

Something

 

Something

you have to say something
even if and though nothing
you have to do something
even if and though nothing
you have to think something
even if and though nothing
the moment demands that
the smart and swift
the stupid and still
pick up and lay down
their thoughts words and deeds
to pick them up and lay them down
endlessly again

©

 

The latest sign that the rule of law in America is endangered. With maybe a glimmer of hope (yes, the lawyers may save us yet!).

Yesterday I reported about an open letter signed by hundreds of former federal prosecutors, a letter saying that given the substantial evidence in the Mueller report, each of them would have indicted Trump for obstruction of justice–except for the Department of Justice guidance that a sitting president not be indicted. Those lawyers who elaborated said it wasn’t even close–that Trump could have been indicted and  convicted for multiple crimes.

At the time it was first released, 300 or so former Department of Justice lawyers, some with as much as 41 years of service, including many former  U.S Attorneys, working in Republican and Democratic administrations from Nixon through Trump, had signed. As of this morning, that number of signers had grown to 680 and is still growing. These lawyers represent over 8,500 years of nonpartisan service in the cause of American justice. In the cause of the rule of law.

The story got some attention for a few hours yesterday, and then sank, as critical stories have a tendency to do in these critical days. Maybe the news media don’t think Americans are interested in this sort of “inside baseball” technical legal issue or that Americans are tired of the whole Mueller thing. Maybe many Americans aren’t interested in this. Maybe Americans think that lawyers are liars who will say anything, including lawyers who work for the previously most respected legal organization in America–the Department of Justice.

A brief note about Sir Thomas More, the Chancellor for Henry VIII. More is celebrated in multiple realms, both religious and legal. He was named by lawyers as the lawyer of the last millennium for his unwavering stand for the rule of law and conscience over selfish motives, convenience or the wishes of a king. He was famously executed for his conscientious resistance.

In Robert Bolt’s play A Man for All Seasons, More explains his steadfast allegiance to the rule of law. When the laws are cut down or ignored one by one, what will be left for us?:

ROPER:  So now you’d give the Devil the benefit of law!

THOMAS MORE: Yes.  What would you do? Cut a great road through the law to get after the Devil?

ROPER:  I’d cut down every law in England to do that!

THOMAS MORE: Oh? And when the last law was down, and the Devil himself turned round on you—where would you hide, Roper, the laws all being flat? This country’s planted thick with laws from coast to coast—man’s laws, not God’s—and if you cut them down—and you’re just the man to do it—d’you really think you could stand upright in the winds that would blow then?  Yes, I’d give the Devil himself the benefit of law, for my own safety’s sake.

 

 

More than 540 former federal prosecutors so far have signed a letter contending that Trump would have been charged with obstruction if he weren’t president.

More than 400 540 former federal prosecutors from Republican and Democratic administrations have signed a letter contending that President Donald Trump would have been charged with obstruction of justice based on the findings of the Mueller report if he weren’t president. And the list of signers is growing.


STATEMENT BY FORMER FEDERAL PROSECUTORS
May 6, 2019

We are former federal prosecutors. We served under both Republican and Democratic administrations at different levels of the federal system: as line attorneys, supervisors, special prosecutors, United States Attorneys, and senior officials at the Department of Justice. The offices in which we served were small, medium, and large; urban, suburban, and rural; and located in all parts of our country.

Each of us believes that the conduct of President Trump described in Special Counsel Robert Mueller’s report would, in the case of any other person not covered by the Office of Legal Counsel policy against indicting a sitting President, result in multiple felony charges for obstruction of justice.

The Mueller report describes several acts that satisfy all of the elements for an obstruction charge: conduct that obstructed or attempted to obstruct the truth-finding process, as to which the evidence of corrupt intent and connection to pending proceedings is overwhelming. These include:

  • The President’s efforts to fire Mueller and to falsify evidence about that effort;
  • The President’s efforts to limit the scope of Mueller’s investigation to exclude his conduct; and
  • The President’s efforts to prevent witnesses from cooperating with investigators probing him and his campaign.

Attempts to fire Mueller and then create false evidence

Despite being advised by then-White House Counsel Don McGahn that he could face legal jeopardy for doing so, Trump directed McGahn on multiple occasions to fire Mueller or to gin up false conflicts of interest as a pretext for getting rid of the Special Counsel. When these acts began to come into public view, Trump made “repeated efforts to have McGahn deny the story” — going so far as to tell McGahn to write a letter “for our files” falsely denying that Trump had directed Mueller’s termination.

Firing Mueller would have seriously impeded the investigation of the President and his associates — obstruction in its most literal sense. Directing the creation of false government records in order to prevent or discredit truthful testimony is similarly unlawful. The Special Counsel’s report states: “Substantial evidence indicates that in repeatedly urging McGahn to dispute that he was ordered to have the Special Counsel terminated, the President acted for the purpose of influencing McGahn’s account in order to deflect or prevent scrutiny of the President’s conduct toward the investigation.”

Attempts to limit the Mueller investigation

The report describes multiple efforts by the president to curtail the scope of the Special Counsel’s investigation.

First, the President repeatedly pressured then-Attorney General Jeff Sessions to reverse his legally-mandated decision to recuse himself from the investigation. The President’s stated reason was that he wanted an attorney general who would “protect” him, including from the Special Counsel investigation. He also directed then-White House Chief of Staff Reince Priebus to fire Sessions and Priebus refused.

Second, after McGahn told the President that he could not contact Sessions himself to discuss the investigation, Trump went outside the White House, instructing his former campaign manager, Corey Lewandowski, to carry a demand to Sessions to direct Mueller to confine his investigation to future elections. Lewandowski tried and failed to contact Sessions in private. After a second meeting with Trump, Lewandowski passed Trump’s message to senior White House official Rick Dearborn, who Lewandowski thought would be a better messenger because of his prior relationship with Sessions. Dearborn did not pass along Trump’s message.

As the report explains, “[s]ubstantial evidence indicates that the President’s effort to have Sessions limit the scope of the Special Counsel’s investigation to future election interference was intended to prevent further investigative scrutiny of the President’s and his campaign’s conduct” — in other words, the President employed a private citizen to try to get the Attorney General to limit the scope of an ongoing investigation into the President and his associates.

All of this conduct — trying to control and impede the investigation against the President by leveraging his authority over others — is similar to conduct we have seen charged against other public officials and people in powerful positions.

Witness tampering and intimidation

The Special Counsel’s report establishes that the President tried to influence the decisions of both Michael Cohen and Paul Manafort with regard to cooperating with investigators. Some of this tampering and intimidation, including the dangling of pardons, was done in plain sight via tweets and public statements; other such behavior was done via private messages through private attorneys, such as Trump counsel Rudy Giuliani’s message to Cohen’s lawyer that Cohen should “[s]leep well tonight[], you have friends in high places.”

Of course, these aren’t the only acts of potential obstruction detailed by the Special Counsel. It would be well within the purview of normal prosecutorial judgment also to charge other acts detailed in the report.

We emphasize that these are not matters of close professional judgment. Of course, there are potential defenses or arguments that could be raised in response to an indictment of the nature we describe here. In our system, every accused person is presumed innocent and it is always the government’s burden to prove its case beyond a reasonable doubt. But, to look at these facts and say that a prosecutor could not probably sustain a conviction for obstruction of justice — the standard set out in Principles of Federal Prosecution — runs counter to logic and our experience.

As former federal prosecutors, we recognize that prosecuting obstruction of justice cases is critical because unchecked obstruction — which allows intentional interference with criminal investigations to go unpunished — puts our whole system of justice at risk. We believe strongly that, but for the OLC memo, the overwhelming weight of professional judgment would come down in favor of prosecution for the conduct outlined in the Mueller Report.

My Wisdom Teachers Assemble

I stood at the front of the room. I shouldn’t be standing there, I realized, as if I was the teacher, and they my students. It was upside down.

I had called them together, the wisdom teachers I had followed over the years. They had no choice but to come and sit in their chairs. This was my assembly.

Some had identifiable names and lives, most historical and actual, but a few apocryphal. Others were general, not a particular person, but a tradition or text.

Many traditions and sub-traditions were represented: Buddhism, Taoism, Judaism, Christianity, Islam and others. Within each tradition, no teacher could claim primacy, no superstars versus stars. There was Abraham Joshua Heschel and Rabbi Nachman of Bratslav. There was Jesus and Thomas Merton. There was Dogen and Shunryu Suzuki Roshi. Among themselves they might make distinctions. But as teachers who had all given me something significant, they were all at parity.

Were they talking with each other or to me? No. They sat silently, looking at me with calm intensity, waiting for me to answer the unasked question: why had I called them all together?

I did have a reason. But now I wondered if I should ask. The question was whether it was time to give up my practice of drawing wisdom from any and all of them, like a hummingbird feeding from an array of beautiful flowers. Instead, I wanted to know, should I focus on one to the exclusion of the others.

I couldn’t bring myself to ask, because I knew, or thought I knew, what they might say. What a stupid question. Or: You already know the answer. Or: There is no answer. Or: What a stupid question. Or, in the case of a Zen teacher who clung to the old ways, I might be beaten with a stick. And deserve it.

I dismissed the venerable assembly. With thanks.

Old scripture, new world: The homosexual ban in Torah portion Acharei Mot

This week’s Torah portion is Acharei Mot, the second part of which is Leviticus 18. It contains very specific laws for sexual conduct, prohibiting practices that Jews must avoid on penalty of death.

Some of the prohibitions are still commonly accepted by most (though not all) in modern times and societies, including bans on incest within extended families and on bestiality. But among them is one that increasingly requires explanation in the face of changing norms–a ban on male homosexual relations. (Lesbian relations are not covered, as Robert Alter notes: “Lesbianism, which surely must have been known in the ancient Near East, is nowhere mentioned, perhaps because no wasting of seed is involved, although the reason for the omission remains unclear.”)

This demands some attention from people of faith who nevertheless believe that homosexual relations are as godly and natural as relations between men and women. The squaring of this circle is actually not that complex, though for some it remains difficult.

It is entirely possible to regard scripture as special, elevated and inspired without treating it as immutable and eternal law. That of course creates its own set of challenges, that is, which of the laws are we to embrace and which do we set aside? The ten commandments contain some valuable guidance we would like generally followed. Not lying, for example, comes immediately to mind.

Here’s the good news. We can do this, we can study and discern what is good and healthy for us individually and as communities. Here’s the inconvenient news. Study and discernment are hard, though rewarding. In my experience, discarding the Bible, or religion for that matter, because of its most pernicious elements and outcomes, is self-defeating and self-denying.

There are people who don’t eat vegetables because, to be honest, some vegetables are pretty terrible or are abysmally prepared. But vegetables are truly wondrous, as taste treats and as part of a healthful diet. You just have to be open to it and work at it a little. And not be put off by the stuff you don’t like and can’t accept.