### Navigating my Slides All my slides are presented using [reveal.js](revealjs.com), and do not exist as Powerpoint or PDF, but instead, as websites. To navigate my slides, use the arrow keys, the onscreen controls, or swipe on mobile. To scan through slides, hit 'Escape'. To print or make a PDF, add ?print-pdf to the URL after .html in Google Chrome and then 'Print' as usual. (Please note that PDF/printing is not 'officially supported' by the instructor, and the results may be wonky in places) --- ### Handout Mode You can also access a handout version of any slideshow by adding ```_handout``` right before .html in the slide URL. So, [Handout Link](https://savethevowels.org/talks/l6_1_intro_handout.html) --- # Linguistics 6: Computers and Language ### Dr. Will Styler - Spring 2022 <img class="r-stretch" src="img/hal9000.jpg" alt="hal9000.jpg The image shows a vertical, rectangular computer interface panel centered against a very dark background that has a horizontal brushed texture, resembling dark metal or wood grain. At the top of the panel is a label containing text. The label appears to be divided into two sections horizontally. On the left side, there is a light blue rectangle with the white letters HAL. Immediately to its right is a black rectangle with the white numbers 9000. Together, they read HAL 9000. Below this label is the most prominent feature: a large, circular red lens or camera eye. This circle is surrounded by a silver metallic ring. The red surface inside the ring is glossy and reflective, showing bright highlights near the top and center, giving it a three-dimensional appearance. In the very center of the red circle, there is a small, bright point of light, resembling a pupil or a reflection. At the bottom of the panel is a rectangular speaker grille. It features a fine mesh pattern with many tiny holes, typical of audio equipment. The entire central unit is framed by a thin silver border. This object represents HAL 9000, an artificial intelligence character from the science fiction film 2001: A Space Odyssey. This description was generated automatically. Please feel free to ask questions if you have further questions about the nature of the image or its meaning within the presentation."> --- ### Today's Plan - Introductions - What is this course about? - What is a computer and how does it work? - Why don't computers speak English? - What will we cover? - What will we ignore? --- # Introductions --- ## Dr. Will Styler Instructor, Linguist, Gigantic Nerd <img class="r-stretch" src="people/will.jpg" alt="will.png The image features a medium shot of a light-skinned man centered in the frame against a blue background. He has a shaved head and a short, dark beard that covers his chin and jawline, with a small patch of hair on his upper lip (a goatee). He is smiling widely, showing his teeth. He is wearing a black collared shirt. On the left side of his chest, there is a small, rectangular logo that reads Columbia in white text. His hands are raised to his chest level, and he is giving two thumbs up. On his left wrist, he wears a silver watch with a round white face and a bright green band. He also wears a dark-colored ring on the ring finger of his left hand. The background appears to be a composite image. The area behind him is a solid teal-blue color. To the right side of the frame, there is a large, modern building structure visible. It features angled concrete supports and glass windows, resembling a brutalist architectural style. To the far left, there are blurry shapes that look like trees or bushes, also tinted blue. There is a slight green outline around the man's silhouette, suggesting he was cut out from another photo using a green screen effect. This description was generated automatically. Please feel free to ask questions if you have further questions about the nature of the image or its meaning within the presentation."> --- ## Ben Lang Graduate IA, Linguist <img class="r-stretch" src="people/benlang.jpg" alt="benlang.jpg The image displays a head-and-shoulders portrait of a young man facing directly forward against a plain, off-white wall. He has short, dark brown curly hair that appears slightly tousled on top. His face features light skin with visible freckles scattered across his nose and cheeks. He has a full, dark brown beard and mustache that covers his chin and upper lip area. He is smiling broadly, showing his upper teeth. His eyes are light-colored, appearing hazel or light brown. He is wearing a white button-down shirt with a collar. The shirt features an abstract pattern consisting of thick, brushstroke-like shapes in black, dark teal, grey, and tan colors. Two small white buttons are visible near the bottom center where the shirt placket meets. There is no text or diagrams present in the image. This description was generated automatically. Please feel free to ask questions if you have further questions about the nature of the image or its meaning within the presentation."> --- ## Hagyeong Shin Graduate IA, Linguist <p>(This audiovisual content has been removed for compliance with recent federal accessibility guidelines. <a href="https://accessibility.ucsd.edu/policies-standards/ucsd-accessibility-guidelines.html">Please see this site for details.</a>)</p> --- ## Yuri Bukhradze Undergraduate IA, Linguist <p>(This audiovisual content has been removed for compliance with recent federal accessibility guidelines. <a href="https://accessibility.ucsd.edu/policies-standards/ucsd-accessibility-guidelines.html">Please see this site for details.</a>)</p> --- ### Who are you? - What's your year? - Ling majors? - Monolingual/Bilingual/Multilingual? - What languages do we speak? - What kinds of computers do you use? --- ## Syllabus and Schedule <http://savethevowels.org/6> --- ## Syllabus Stuff which bears repeating <img class="r-stretch" src="img/bearsrepeating.jpg" alt="bearsrepeating.jpg The image displays a grid of twelve identical photographs arranged in three rows and four columns. Because every panel shows the exact same picture, I will describe the single unique image that is repeated across the entire layout. Each photograph features an American black bear sitting upright and facing directly forward toward the viewer. The bear has thick, dark black fur covering its head, shoulders, and body. Its face features a distinct tan or light brown muzzle that contrasts with the black fur of its snout and cheeks. It has small, rounded ears perched on top of its head and dark eyes looking straight ahead. A small black nose is visible at the tip of its tan muzzle. Behind the bear is a background consisting of large, grey rocks or a stone wall. In the upper left corner of each panel, there are patches of green leafy vegetation growing among the rocks. There is no text, diagrams, numbers, or figures present in this image. This description was generated automatically. Please feel free to ask questions if you have further questions about the nature of the image or its meaning within the presentation."> --- ### Syllabus Stuff which bears repeating * Check your Canvas * Come to office hours with questions. * The syllabus will change! * **We are here to help!** --- ### We're going to be posting lecture videos on Podcast.ucsd.edu - You'll notice me restating questions afterwards - You might end up with videos from Winter 2021 if I get sick or Podcast breaks down - Sorry about that! --- ### We're back in meatspace! - Here's hoping it stays that way - We have a plan in place, in case it doesn't - Come to class healthy, masked, and prepared - **Please make an effort to talk more loudly when asking questions or answering!** - You have no excuse to come to class sick! - The attendance policy is lax, and you can always just podcast. --- ### Classroom safety requirements - Everyone must properly wear face coverings. - Stay current with your COVID-19 testing. - Monitor your symptoms, stay home if you’re sick and report positive cases. - Keep your hands clean, cover your cough and don’t touch your face. --- ### Pro-Tip: Sincere effort is incredibly important to me - 'Blow off' the class, or try to lawyer or cajole your way into an A, and you'll find much no sympathy nor help - Low effort, low integrity, or 'cut-corners' work insults the people who you need help from - Put in the effort for us, and we’ll put in effort for you - We will bend over backwards to help students who are making a sincere effort - **If you're struggling, talk to us ASAP** --- ### Any questions? --- # Computers don't speak our language natively --- ## What is a computer? - (Sorry, CSE people) --- ### Basic Computer Hardware Anatomy - The CPU ("Processor") - Does mathematical and logical operations on memory contents - Memory (L1/L2/L3 Cache, Random Access Memory (RAM)) - Stores the values and data that the CPU needs *immediate, fast* access to - Generally relatively small amounts of storage (e.g. totals in the tens of Gigabytes, or GB) - Slow Storage ("Hard Drive (HD)", "Solid State Drive (SSD)", "Disk") - Stores the data that the CPU might need slower access to - Large amounts of storage (Hundreds of GB to many Terabytes (TB)) - The IO - Inputs (Network, Keyboards/Mice, etc.) - Outputs (Network, Graphics/Monitors, Printers, Audio, etc.) --- ### Awkward Metaphor! <img class="r-stretch" src="img/office.jpg" alt="office.jpg This image depicts a bright, modern office space with a minimalist design. The room features white walls and dark grey carpeting. On the left side of the image, there is a large window structure consisting of three vertical panes. The leftmost pane is wide and lets in significant natural light, illuminating the room. Through the glass, you can see what appears to be an exterior wall or railing of another building, suggesting this office is located on an upper floor. In the far left corner, near the window, stands a small, round side table with a silver pedestal base. On top of it sits a dark, rectangular object that resembles a speaker or a decorative box. The center of the room is dominated by a large white desk with black legs. The desk is set up as a dual workstation. Two black articulated desk lamps are clamped to the back edge of the desk; one is positioned over the left side and the other over the right side, both with adjustable arms pointing downwards. On the left side of the desk surface, there is an open laptop computer surrounded by papers and a small stack of books or notebooks. Underneath this section of the desk sits a white filing cabinet with three drawers and silver handles. Tucked behind the laptop area is a black mesh office chair, partially visible. On the right side of the desk, there are more scattered papers, a cup holding pens or pencils, and what looks like a tablet or another flat device. A second black mesh office chair with wheels is positioned in front of this section of the desk, facing slightly towards the left. Underneath the right side of the desk, near the leg, is a dark trash bin. On the right wall, there is a tall shelving unit mounted to the wall. It has black vertical supports and white shelves. - The top shelf holds three large binders standing upright; two are white and one has an orange or pink spine. Next to them is a stack of white boxes. - Below that, partially obscured by the shelves, is a dark computer monitor screen. - On the shelf below the monitor level, there is a white geometric vase containing dried sticks or flowers. To its right is a fan-like arrangement of colorful papers or folders in shades of orange, pink, and red. - Further down on lower shelves, there are stacks of books and magazines. One stack has black spines, while another has white covers with red accents. There are no people visible in the image, and there is no legible text or diagrams present. The overall impression is of a clean, organized, and well-lit workspace. This description was generated automatically. Please feel free to ask questions if you have further questions about the nature of the image or its meaning within the presentation."> --- ### Basic Computer Anatomy - CPU, Memory, and Storage - Networking (e.g. Ethernet, Wifi, Bluetooth) - Graphics Cards (GPUs) (Connects to a monitor or display) - These are also used for many kinds of machine learning calculations! - Audio Cards (Connects to speakers and microphones) - Peripheral Connections (e.g. USB, Thunderbolt) - Specialized chips (e.g. motion sensing, touchscreen controller, security chips (TPUs)) --- ### These are not always discrete items - Most computers have a "motherboard" which contains USB, Audio, Networking, I/O - Slots for CPU/RAM/Storage/Video Cards - Modern phones and some computers have everything on a single board --- ### iPhone 11 <img class="r-stretch" src="comp/iphone11.jpg" alt="iphone11.jpg The image is a detailed technical diagram of an iPhone11 Pro & Pro Max AP IC Distribution drawing. It provides a comprehensive layout of various components within these models' electronic systems. Left Side: iPhone11 Pro & Pro Max AP IC Distribution - Top Section: - The top section shows the battery and its connections, labeled as BATTERY CONNECTOR. - Below that is the dock connector for charging. - Middle Section: - This area includes the display connector, which connects to the screen of the device. - Bottom Section: - The bottom part features a boot loader section with various connectors and components. It also includes labels such as Bootloader, Dock Connector, Wide Connector, and NFC Connector. Right Side: Detailed Components - Central Component: - At the center is an A13 CPU labeled, which stands for Apple's Bionic SoC (System on a Chip). This chip is responsible for processing tasks within the device. - Surrounding Components: - Surrounding the central CPU are various other ICs and connectors. These include: - Power IC and Bus Projector Control. - Camera power IC, which likely powers the camera system. - Light sensor IC, which detects light levels for features like Auto-Brightness. - High frequency amplifier, which might be related to wireless communication or other high-frequency signals. - Additional Connectors: - There are several connectors and labels around these components, such as FS3RS, FS3R, and BUSPROJECTOR. These likely refer to specific pins or connections on the circuit board. PCB Number - The bottom right corner of the image includes a PCB number: 820-01682-08. This diagram is highly technical, providing an in-depth look at the internal components and their arrangement within the iPhone11 Pro & Pro Max models. It's designed for engineers or technicians to understand the layout and function of these devices' electronic systems. This description was generated automatically from image files by a local LLM, and thus, may not be fully accurate. Please feel free to ask questions if you have further questions about the nature of the image or its meaning within the presentation."> --- ### iPhone 11 <img class="r-stretch" src="comp/iphone11_2.jpg" alt="iphone112.jpg The image is a detailed diagram illustrating the internal components of an iPhone model, specifically labeled as iPhone11 Pro & Pro Max RF IC Distribution. The diagram includes various electronic parts and their locations within the phone's circuit board. At the top center of the diagram, there are labels indicating different sections such as Baseband chip, RF IC Transceiver, NFC, and WIFI+BT. These labels help to identify where each component is situated on the circuit board. The circuit board itself is divided into several areas with components placed in specific locations. For example: - The Baseband chip is located at the bottom left. - The RF IC Transceiver is positioned near the center, slightly towards the top right. - The NFC section is situated to the right of the RF IC Transceiver. - The WIFI+BT area is on the far right side. Each component has a corresponding label with its name and sometimes additional information such as part numbers or manufacturer names. For instance, there are labels like UQVETE PA PHO, which likely refers to a specific type of power amplifier chip used in the device's radio frequency (RF) circuitry. The diagram is quite technical and detailed, providing an educational view into how these components work together within the phone’s hardware. The text at the bottom left corner reads Easy-draw, suggesting that this might be part of a series or collection of such diagrams created by Easy-draw. This description was generated automatically from image files by a local LLM, and thus, may not be fully accurate. Please feel free to ask questions if you have further questions about the nature of the image or its meaning within the presentation."> --- ### We're going to take a broad view of "computer" in this class - Your computer - A server in a server farm - Your smartphone or tablet - Your smartwatch - *Anything with a processor, memory, and storage* --- ## How does a computer work? --- ### Every single thing your computer does is math - CPU fetches an instruction from memory - CPU figures out what needs to be done with what data - CPU takes the relevant data from the given places in memory and does the desired task - Usually arithmetic or logical (is X the same as Y?) - CPU puts the results back into the memory, and fetches the next instruction - Repeat ~100,000,000,000 times per second --- ### All of this is done in a very low level type of code - Programs are translated ('compiled') from a human-readable programming language like Python or C++ into processor instructions - The programs themselves turn these low-level results back into something a human can understand --- ### C++ ``` #include <iostream> using namespace std; int main() { cout << "Hello, LIGN 6!"; return 0; } ``` --- ### Some assembly code ```assembly # addition mov ax, 5 # load number in ax mov bx, 2 # load number in bx add ax, bx # accumulate sum in ax # subtraction mov cx, 10 mov dx, 3 sub cx, dx # accumulate difference in cx # multiplication - 8 bit source mov al, 5 mov bl, 10 mul bl # result in ax # divison - 8 bit source mov al, 23 mov bl, 4 div bl # quotient in al, remainder in ah ``` --- ### Here's a detailed look at this in action [Ben Eater's 'Comparing C to Machine Language'](https://www.youtube.com/watch?v=yOyaJXpAYZQ) <https://www.youtube.com/watch?v=yOyaJXpAYZQ> --- ## So, Computers don't speak English? --- ### None of this is human language - Programming Languages are designed for computers, not for humans - Commands are designed to be unambiguously converted into logical or mathematical instructions - Limited set of functions and grammatical features - Cannot be changed "on the fly" - Shhh, Lisp people - Programming languages are not fully productive nor creative - There are *many* things which cannot be expressed in a programming language --- ### Human Language is *very* different - Sentences cannot be unambiguously converted into logical and mathematical instructions - Unlimited set of functions and grammatical features - Can be modified "on the fly" - Fully Productive and Creative - Anything can be said using any human language, given sufficient time and vocabulary --- ### Most human sentences cannot be "translated" for a computer without substantial loss - "Add 3 to 5, then check to see if the result is bigger than the number of characters in 'Laptop'" - "The cat is on the mat" - "I'm going to watch the Office tonight" - "That hurt my dignity, and made me very sad" - "I love you" --- ### Computers don't understand speech - Sound waves are not fundamentally accessible to computers - (Nor are visual inputs for signed language, but we'll focus on speech) - Data encoded by tongue gestures and carried by sound is hard to convert back - We're amazingly good at it - Computers lack tongues to produce speech (and to percieve it?) --- ### Computers don't understand the world - "The cat is on the mat" - "I saw a penguin" - "I saw the Penguin" - "The diplomat is a bachelor." - "I long for her touch." --- ### There is a *vast* gulf between computers and human language - Luckily, there's a field for that --- ## Natural Language Processing (NLP) The field dedicated to the computational processing, analysis, and interaction with human language - (NLP also means 'Neurolinguistic Programming' in some circles, but it is *completely* unrelated to computational linguistics) - **We're focusing on Natural Language Processing this quarter!** --- # Course Plan --- ## What will we cover? --- ### We're going to focus on interactions with language technology - Virtual Assistants like Siri, Alexa, Google Assistant, or Cortana - They have *all* of the language problems at once - The most advanced consumer-facing Natural Language Processing around - Other tools like predictive text, dictation, Text-to-Speech - This is a Natural Language Processing course, but that's our focus --- ### We'll look at most fields within natural language processing - Machine Learning - Speech-to-Text (Automatic Speech Recognition, ASR) - Text-to-Speech (TTS) - Building a Language Model - Natural Language Parsing - Computational Semantics - Computational Pragmatics --- ### We're going to ask the same four questions each time - How does it work for humans, roughly? - How can we make it work for computers? - What makes doing this really, *really* hard? - What can we do to break it? --- ### We're going to talk about some problems at a more technical level - "How do you teach computers to learn?" - "How do computers even work with sound, given that waves aren't 0 and 1?" - "How do we work with the kinds of tools used in this field?" - "How do we deal with the huge amounts of language data needed to model language?" - "How do we create meaning-annotated data that computers can learn from?" --- ### We'll also discuss some basic linguistics - Speech and Speech Acoustics - Morphology and Syntax - Lexical Semantics - Basic Pragmatics --- ### ... and we're gonna try and do that in a single quarter - <img class="r-stretch" src="humorimg/jlaw_yeah_ok.gif" alt="jlawyeahok.gif The image displays a medium shot of actress Jennifer Lawrence standing in front of a dark background. She is facing forward, looking slightly to the left of the camera lens but mostly straight ahead, with a soft, closed-mouth smile. Her fair skin and blue eyes are clearly visible. Her blonde hair is styled with side-swept bangs across her forehead. A loose braid falls over her left shoulder, resting against her chest. She is wearing a white sleeveless top or dress that features a blue pattern resembling abstract waves or feathers. The garment has ruffled, fluttery sleeves at the shoulders. A thin gold chain necklace is visible around her neck. Behind her is a black backdrop, likely a step-and-repeat banner used at an event. Visible text includes NATURAL RESOURCE CENTER near the top center, partially obscured by her hair. To her right (the viewer's left), large white letters spell out NE, with smaller text below it that appears to read SPEAKING OF... This description was generated automatically. Please feel free to ask questions if you have further questions about the nature of the image or its meaning within the presentation."> --- ## What *won't* we cover? --- ### We're going to focus on English in this class - All of these issues will be present in other languages - We'll occasionally touch on issues which pertain to other languages - English will provide us with more than enough issues. - We're also going to side-step machine translation --- ### We're going to focus on spoken languages - Signed languages are Language, and merit study - ... but they're generally not written, and motion-capture questions are outside the scope --- ### We're going to have to stay close to the surface - Any one of these topics could be two graduate-level seminars - One for humans, one for computers - Think of this like a tasting menu of really hard problems in language and computing - The joys of a lower division class in the quarter system! --- ### We're not going to teach you to code - You'll learn to use some phonetic software - You'll learn some Unix basics, and we'll see some Python - ... and ambitious students will have the opportunity to write more code - We're going to rely on other people's code (or mine) to make this class work - ... and we'll focus on concepts, rather than code --- ### You won't leave this class being able to write the next Alexa - We're focusing here on the problems, not the solutions - We're going to be the linguists in the room, not the engineers - We're thinking about this schematically, not in detail --- ### Instead, I hope you'll leave the class with three main understandings --- ## Current NLP Tools suck --- <img class="r-stretch" src="comp/deanna_voicemail.jpg" alt="deannavoicemail.jpg The image is a screenshot of an email inbox on what appears to be Microsoft Outlook. The email in focus is titled Voice Mail from 49447 (19 seconds) and it has been received by the user with the email address ending @ad.ucsd.edu. The sender's name, 49447, is displayed next to their email address. The body of the voice mail message reads: Hey Lowe! It’s Canary Center Med Tech support. Just calling to see how your camp experiences calling if you need thing just let me know my phone number or my extension here is 94 it. There's a second line that says, Is sorry excuse me 49447 again that’s 49447 have a good weekend bye. The email was received at 2:44 PM and the sender has indicated they are from the Canary Center Med Tech support. The email is marked as being in the inbox folder. At the bottom of the email, there's information about the caller ID which shows Caller-Id: 49447. It also mentions that this voice mail was created using Microsoft Speech Technology and provides a link to learn more about it. The background of the email interface is white with blue accents. The text is primarily black for readability against the light background, except for some elements like the sender's name which are in blue. There are icons at the top right corner indicating options such as delete, print, or forward the email. This description was generated automatically from image files by a local LLM, and thus, may not be fully accurate. Please feel free to ask questions if you have further questions about the nature of the image or its meaning within the presentation."> --- "Hey Lowe it's canary center med tech support just calling to see how your camp experiences calling if you need thing just let me know my phone number or my extension here is 94 it. Is sorry excuse me 49447 again that's 49447 have a good weekend bye." - "Hey Will it's Deanna Roussin from Ed Tech support just calling in to see how your Canvas experience is going if you need anything just let me know. My phone number or my extension here is 94 [...] Sorry excuse me 49447 again that's 49447. Have a good weekend. Bye." <p>(This audiovisual content has been removed for compliance with recent federal accessibility guidelines. <a href="https://accessibility.ucsd.edu/policies-standards/ucsd-accessibility-guidelines.html">Please see this site for details.</a>)</p> --- ### From T.S Eliot's *The Wasteland* > What are the roots that clutch, what branches grow<br> Out of this stony rubbish? Son of man,<br> You cannot say, or guess, for you know only<br> A heap of broken images, where the sun beats,<br> And the dead tree gives no shelter, the cricket no relief,<br> And the dry stone no sound of water. Only<br> There is shadow under this red rock,<br> (Come in under the shadow of this red rock),<br> And I will show you something different from either<br> Your shadow at morning striding behind you<br> Or your shadow at evening rising to meet you;<br> I will show you fear in a handful of dust. --- ### From T.S Eliot's *The Wasteland* > What are the roots that clutch, what branches grow<br> Out of this stony rubbish? Son of man,<br> You cannot say, or guess, for you know only<br> A heap of broken images, where the sun beats,<br> And the dead tree gives no shelter, the cricket no relief,<br> And the dry stone no sound of water. Only<br> There is shadow under this red rock,<br> (Come in under the shadow of this red rock),<br> And I will show you something different from either<br> Your shadow at morning striding behind you<br> Or your shadow at evening rising to meet you;<br> I will show you fear in a handful of dust. <p>(This audiovisual content has been removed for compliance with recent federal accessibility guidelines. <a href="https://accessibility.ucsd.edu/policies-standards/ucsd-accessibility-guidelines.html">Please see this site for details.</a>)</p> --- <img class="r-stretch" src="humorimg/siricallambulance.jpg" alt="siricallambulance.jpg The image shows a screenshot from an iPhone displaying a conversation with Siri, the virtual assistant on iPhones. The background of the screen is black, and there are two text bubbles indicating a dialogue between the user and Siri. At the top left corner, you can see Sprint which indicates the carrier of the phone's service. Next to it, there’s an icon for Wi-Fi connectivity, followed by the time displayed as 9:16 PM. On the right side at the top, there is a battery indicator showing that the battery level is at 77%. The conversation starts with Siri asking What can I help you with? The user responds in quotation marks saying, Siri I'm bleeding really bad can you call me an ambulance. Below this message are two buttons labeled Cancel and Yes, suggesting options for the user to confirm or cancel their request. Below that is another text bubble from Siri stating, From now on, I'll call you 'An Ambulance'. OK? This indicates that Siri has acknowledged the user's request and will use a shortened version of the word ambulance in future interactions. There are no buttons for this response; it seems to be an acknowledgment rather than a prompt for action. At the bottom center of the screen, there is a microphone icon with a purple circle around it, indicating that Siri can now listen to further commands or questions from the user. The overall layout and design elements are typical of iOS 6, which was released in 2012. This description was generated automatically from image files by a local LLM, and thus, may not be fully accurate. Please feel free to ask questions if you have further questions about the nature of the image or its meaning within the presentation."> --- ### "Alexa, what's my name?" - "I'm talking to Will, this is Will's account" --- ### "Alexa, who am I?" - "I'm talking to Will, this is Will's account" --- ### "Alexa, what do people call me?" - "Here's something I found on the web... According to corporate.com, friends/family usually call me Alex, but when I meet people for the first time, I usually introduce myself with my full first name..." --- <img class="r-stretch" src="humorimg/wtf.gif" alt="wtf.gif The image shows a medium shot of a man, who appears to be the television host Steve Harvey. He has dark skin and short black hair with a neatly trimmed mustache. He is wearing a light tan or beige suit jacket over a white dress shirt. His tie features a busy pattern with shades of pink and purple, possibly floral. A crisp white pocket square is folded in his breast pocket. He is looking slightly to the right of the camera with a subtle expression that suggests he might be suppressing a laugh or reacting with mild skepticism; his eyes are narrowed slightly. The background is out of focus but features soft gradients of purple and orange-brown, typical of a television studio set lighting. There is no text or diagrams visible in this image. This description was generated automatically. Please feel free to ask questions if you have further questions about the nature of the image or its meaning within the presentation."> --- ### "Alexa, what do my friends call me?" - [Alexa shuts down] --- ### "Alexa, I'd like to make a purchase" - "I can help you order reeveryday items, track a purchase"? --- ### "Alexa, I'd like to engage in a transaction." - [Alexa shuts down] --- ### "Alexa, I'd like to give you currency in exchange for a product." - [Alexa shuts down] --- ## Current Virtual Assistants are also amazing --- ### "Alexa, play Rapper's Delight" - "Rapper's Delight by the Sugar Hill Gang on Spotify" *then plays it* --- ### "Alexa, what's my wife's name?" - "If you don't know, you're in trouble soon." - "If you'd like me to remember your wife's name, just tell me "Remember my wife's name is Marge" --- ### "Alexa, what's my cat's name?" - Historically answered "I would guess your cat's name is fluffy, or pickles, or is it midnight? Whatever it is, I hope that kitty is doing well." - Now [Alexa shuts down] --- ### "Hey Siri, how long to work?" - "Traffic to work is light, so it should take 10 minutes via Voigt drive" - This is **amazing** --- <img class="r-stretch" src="comp/route_to_work.png" alt="routetowork.png The image is a map showing a route through an urban area with various streets, landmarks, and green spaces marked on it. The map includes labels for different locations such as University City, La Jolla Village, and UC San Diego. There are also symbols indicating parks like Carmont Park and California, San Diego Park. The route is highlighted in blue and starts from the bottom left corner of the image, moving northward. It passes through several streets including Nob Hill Dr, La Jolla Village Dr, and Via Marconi. The route then curves to the right as it heads toward the center of the map where there are more detailed labels for landmarks such as UC San Diego School of Medicine and Scrapers Hospital La Jolla. The map also includes a small red pin near the center, which likely marks a specific location or starting point. The overall layout shows a mix of residential areas with green spaces interspersed throughout. There are no people depicted in this image; it is purely a geographical representation of an area. This description was generated automatically from image files by a local LLM, and thus, may not be fully accurate. Please feel free to ask questions if you have further questions about the nature of the image or its meaning within the presentation."> --- ### This quarter will focus on that duality: These systems are awful, and amazing - We'll talk about why that is - We'll about the kinds of tools that they use to get things done - ... and where progress remains to be made --- ## For next time... - Read the syllabus carefully - Activity 1 is on Canvas under 'Discussions' - We'll talk a bit about machine learning, and how computers can come anywhere near these problems --- <huge>Thank you!</huge>