Sunday, June 25, 2023

Sam Altman: AI is The Foremost Step in Human-Technology Integration


The CEO of OpenAI Inc., a prominent artificial intelligence startup, acknowledged the potential risks associated with the rapid advancement of AI technology. Emphasizing the importance of responsible use, the CEO highlighted the myriad ways in which AI could veer off track. However, despite the associated risks, the CEO maintained that the benefits of AI outweigh the costs, stating, 'We often engage with potentially hazardous technology that possesses the capacity for misuse.'

During an interview at the Bloomberg Technology Summit in San Francisco, Altman, the prominent figure in the field of artificial intelligence, addressed the mounting apprehension surrounding the swift advancements in AI technology. Altman's advocacy for heightened regulation of AI has been evident in recent months, with frequent engagements with officials worldwide to promote responsible governance of AI.

In spite of the inherent challenges arising from the exponential technological shift, Altman emphasized the profound positive impact that AI could have across various fields. Within his discussion, he specifically cited medicine, science, and education as areas where AI's transformative capabilities hold great promise.

Altman expressed the belief that the eradication of poverty would be a positive outcome; however, he emphasized the need for effective risk management in order to achieve this goal.

With a valuation surpassing $27 billion, OpenAI stands at the vanguard of the rapidly growing landscape of venture-backed AI enterprises. When questioned about personal financial gains resulting from OpenAI's success, Altman asserted, 'I am content with my current wealth,' underscoring that his motivations extend beyond monetary considerations.

Expressing the difficulty of conveying the concept of having sufficient wealth, Altman acknowledged the intrinsic human inclination to seek purpose and engage in impactful endeavors. He stated, 'It is inherent in our nature to strive for meaningful contributions and work on endeavors that truly matter.'

According to Altman, the forthcoming phase involving technology is poised to be the most significant milestone in human history. He emphasized his strong personal commitment to this endeavor, underscoring the depth of his concern for its successful outcome.

Elon Musk, who played a role in the inception of OpenAI alongside Altman, has since voiced concerns about the organization and its potential risks. Altman acknowledged Musk's deep commitment to AI safety and regarded his criticisms as stemming from a genuine concern. When asked about the hypothetical "cage match" between Musk and fellow billionaire Mark Zuckerberg, Altman humorously remarked, 'I would certainly be interested in witnessing such an event.'

OpenAI's impressive lineup of products, such as the renowned chatbot ChatGPT and the innovative image generator Dall-E, has captivated audiences with their remarkable capabilities. These breakthrough advancements have not only mesmerized onlookers but have also ignited a significant surge in investment and entrepreneurial interest. Venture capital investors and ambitious entrepreneurs are actively competing to contribute to the establishment of a transformative technological era.

OpenAI has adopted a revenue-generating strategy by providing companies with access to the essential application programming interfaces (APIs) required to develop their own software utilizing its powerful AI models. Additionally, the company offers a premium version of its renowned chatbot, known as ChatGPT Plus, which is available for purchase. While OpenAI does not disclose specific details regarding its total sales figures, these revenue streams contribute to the company's financial success.

According to sources familiar with the matter, Microsoft Corp. has made a substantial investment of $13 billion in OpenAI. A significant portion of this investment will be allocated towards reimbursing Microsoft for the utilization of its Azure cloud infrastructure, which is instrumental in training and deploying OpenAI's advanced AI models.

The rapid expansion and capabilities of the burgeoning AI industry have prompted governments and regulatory bodies to proactively establish frameworks to oversee its development. Altman, along with other leading experts in artificial intelligence, recently convened with President Joe Biden in San Francisco to discuss the matter. As part of his extensive engagement, the CEO has been actively traveling and delivering speeches on AI, including a notable appearance in Washington, where he cautioned U.S. senators about the potential risks associated with the technology, emphasizing that in the event of misalignment, the consequences can be significant.

Prominent AI corporations such as Microsoft and Alphabet Inc.'s Google have expressed their commitment to engaging in an impartial public assessment of their AI systems. However, in addition to industry-led initiatives, there is also a push for comprehensive regulation in the United States. The Commerce Department announced earlier this year that it was exploring the possibility of implementing regulations that would mandate AI models to undergo a certification process prior to their release.

Last month, Altman aligned himself with a group of over 350 executives and researchers by endorsing a concise statement that calls for heightened attention and prioritization of risk mitigation related to AI. The statement emphasizes the need to recognize AI as a global priority on par with other societal-scale risks, including pandemics and nuclear war.

While technology leaders issue dire warnings, a segment of AI researchers maintain that concerns about artificial intelligence destroying humanity are premature. They argue that diverting attention to doomsday scenarios detracts from pressing issues such as algorithmic bias, racism, and the proliferation of disinformation.

The introduction of OpenAI's ChatGPT and Dall-E in the previous year has ignited a wave of inspiration among startups to integrate artificial intelligence into diverse sectors, spanning financial services, consumer goods, healthcare, and entertainment. According to Bloomberg Intelligence analyst Mandeep Singh, the generative AI market is projected to experience a significant growth of 42% and reach a value of $1.3 trillion by 2032.

Labels: , , , , , , , , , , , , ,

Friday, June 16, 2023

Reimagining Artificial Intelligence through Hyperdimensional Computing


In spite of the remarkable achievements of ChatGPT and similar large language models, there are growing concerns about the trajectory of the underlying artificial neural networks (ANNs).

There are two prominent issues with artificial neural networks (ANNs), as highlighted by Cornelia Fermüller, a computer scientist at the University of Maryland. Firstly, ANNs exhibit a remarkably high power consumption, which poses sustainability concerns. Secondly, ANNs lack transparency, making it arduous to unravel their inner workings and comprehend the reasons for their remarkable performance. Consequently, leveraging analogy-based reasoning, a fundamental human cognitive ability involving symbolic representations of objects, concepts, and their associations, becomes an elusive goal within ANNs.

The limitations observed in ANNs can be attributed to the underlying architecture and constituent elements, namely individual artificial neurons. These neurons function by receiving inputs, conducting computations, and generating outputs. Contemporary ANNs are intricate systems comprising interconnected computational units that are trained to perform specific tasks.

The limitations of ANNs have long been apparent, as exemplified by the challenge of differentiating circles from squares. To address this, an ANN may employ two output neurons—one dedicated to identifying circles and the other to recognizing squares. However, if the objective involves incorporating color information, such as distinguishing between blue and red shapes, the complexity escalates, necessitating the use of four output neurons: one for each combination of color and shape (blue circle, blue square, red circle, red square). As the number of distinct features grows, the requirement for an augmented number of neurons becomes inevitable.

This approach is not reflective of how our brains perceive the natural world, considering its rich and diverse array of variations. Adopting such a perspective would imply that our brains are equipped with individual neurons dedicated to detecting every possible combination, leading to notions like a specific neuron responsible for identifying a purple Volkswagen," explained Bruno Olshausen, a neuroscientist at the University of California, Berkeley.

Olshausen and his colleagues present a contrasting perspective, suggesting that the brain's information representation is mediated by the combined activity of multiple neurons. Thus, the perception of a purple Volkswagen is not encoded solely by the behavior of a single neuron, but rather by the coordinated firing patterns exhibited by thousands of neurons. Notably, these same sets of neurons, engaging in different firing configurations, have the potential to represent entirely different concepts, such as that of a pink Cadillac.

This premise sets the stage for an entirely novel computational paradigm known as hyperdimensional computing. Crucially, this approach revolves around the representation of discrete fragments of information, be it the concept of a car, its distinctive characteristics encompassing make, model, or color, or the comprehensive integration of these attributes, as a unified construct termed a hyperdimensional vector.

In essence, a vector denotes a structured sequence of numerical values. For instance, a three-dimensional vector encompasses three numerical components: the x, y, and z coordinates that delineate a point within a three-dimensional realm. Conversely, a hyperdimensional vector, often referred to as a hypervector, encompasses an array of numbers, perhaps even spanning 10,000, symbolizing a point situated within a vast 10,000-dimensional space. Leveraging these mathematical constructs and the associated algebraic operations that govern them bestows upon us a remarkably versatile and potent toolset, capable of transcending certain limitations within contemporary computing and paving the way for a novel paradigm in artificial intelligence.

Olshausen expressed profound enthusiasm for this development, asserting that it represents the most exciting advancement he has encountered throughout his extensive career. In his view, as well as that of numerous experts, hyperdimensional computing heralds a transformative era characterized by computational efficiency, resilience, and unparalleled transparency in machine-driven decision-making.

Enter High-Dimensional Spaces

To comprehend the role of hypervectors in enabling computing capabilities, let us revisit the scenario involving images containing red circles and blue squares. In this context, we necessitate the utilization of vectors to represent the fundamental variables, namely SHAPE and COLOR. Furthermore, vectors are required to encapsulate the distinct values that can be assigned to these variables, encompassing CIRCLE, SQUARE, BLUE, and RED.

Each vector must exhibit distinctiveness, a characteristic that can be quantified through the property of orthogonality, denoting the perpendicular relationship between vectors. In three-dimensional (3D) space, three vectors achieve orthogonality by aligning with the x, y, and z axes, respectively. Extending this concept to a 10,000-dimensional space, it becomes evident that there exist 10,000 mutually orthogonal vectors.

When we introduce the possibility of vectors being approximately orthogonal, the quantity of distinct vectors in a high-dimensional space expands exponentially. In the context of a 10,000-dimensional space, the number of nearly orthogonal vectors reaches millions.

To represent SHAPE, COLOR, CIRCLE, SQUARE, BLUE, and RED as distinct vectors, we can take advantage of the abundance of nearly orthogonal vectors in a high-dimensional space. Assigning six random vectors to represent these six items is a practical approach, as the likelihood of them being nearly orthogonal is extremely high. In a seminal paper from 2009, Pentti Kanerva, a researcher at the Redwood Center for Theoretical Neuroscience at the University of California, Berkeley, emphasized the ease of generating nearly orthogonal vectors as a key advantage of hyperdimensional representation.

The aforementioned paper represents an evolution of research initiated in the mid-1990s by Kanerva and Tony Plate, who was pursuing his doctorate under the guidance of Geoff Hinton at the University of Toronto. Independently, Kanerva and Plate laid the foundation for the algebraic framework governing hypervector manipulation, thereby providing initial insights into its potential for high-dimensional computing.

The computational system devised by Kanerva and Plate provides a comprehensive framework for manipulating the hypervectors associated with shapes and colors. Through the application of specific mathematical operations, these hypervectors can be transformed, reflecting the symbolic manipulation of corresponding conceptual representations.

Within the hyperdimensional computing framework, the first fundamental operation is multiplication, which allows for the fusion of concepts. By multiplying the hypervector representing SHAPE with the hypervector representing CIRCLE, a new composite vector emerges, symbolizing the concept of 'SHAPE is CIRCLE.' Notably, this composite vector possesses nearly orthogonal properties to both SHAPE and CIRCLE, while still retaining the recoverable individual components. This feature proves essential when it comes to extracting specific information from bound vectors. For instance, by employing an appropriate unbinding process, the hypervector representing the color PURPLE can be retrieved from a bound vector that represents a Volkswagen.

Within the framework of hyperdimensional computing, the second essential operation is addition, which facilitates the generation of a new vector known as a superposition, representing a combination of concepts. For instance, by adding together two bound vectors, namely 'SHAPE is CIRCLE' and 'COLOR is RED,' a composite vector emerges, symbolizing a circular shape that is red in color. Similarly, the superposed vector can be decomposed, allowing for the retrieval of its constituent components.

The third crucial operation in hyperdimensional computing is permutation, which involves reorganizing the individual elements within vectors. As an illustration, suppose you have a three-dimensional vector with labeled values x, y, and z. Through permutation, you can rearrange the values, shifting x to y, y to z, and z to x. According to Kanerva, this capability of permutation enables the construction of structure and facilitates the handling of sequential phenomena. To demonstrate, consider two events represented by hypervectors A and B. While superposing them into a single vector would obliterate the order of events, combining addition with permutation preserves the temporal sequence. By reversing the operations, the events can be retrieved in their original order.

Collectively, these three operations proved to be sufficient in establishing a formal algebra of hypervectors, which in turn facilitated symbolic reasoning. However, despite the transformative potential of hyperdimensional computing, many researchers, including Olshausen, initially struggled to fully comprehend its implications. As Olshausen admitted, the significance of this paradigm didn't immediately resonate with him, stating, 'It just didn't sink in.

Harnessing the Power

In 2015, Eric Weiss, a student under Olshausen's guidance, showcased a remarkable facet of hyperdimensional computing's distinct capabilities. Weiss successfully devised a method to encapsulate a complex image within a singular hyperdimensional vector, encompassing comprehensive information about all the objects present, including their diverse attributes such as colors, positions, and sizes.

Olshausen vividly recalls the transformative moment, exclaiming, 'I was practically flabbergasted! It was as if a sudden burst of illumination flooded my mind.' Such was his reaction when Eric Weiss presented his findings, prompting Olshausen to exclaim, 'I practically fell out of my chair!'

Following this breakthrough, an increasing number of research teams delved into the development of hyperdimensional algorithms aimed at emulating fundamental tasks previously undertaken by deep neural networks approximately two decades earlier, including image classification.

Let us examine an annotated dataset comprising images depicting handwritten digits. Through the utilization of a predefined scheme, an algorithm assesses the distinctive characteristics of each image. Subsequently, the algorithm generates a hypervector corresponding to each image. The algorithm further combines the hypervectors of all zero images, thereby generating a hypervector that represents the concept of zero. This process is then repeated for all digits, resulting in the creation of ten distinct 'class' hypervectors, one for each digit.

Subsequently, when presented with an unlabeled image, the algorithm proceeds to generate a hypervector that represents this new image. The hypervector is then compared against the previously stored class hypervectors. Through this comparison process, the algorithm identifies the digit to which the new image bears the closest resemblance.

However, this is merely the initial stage. The true potential of hyperdimensional computing lies in its capacity to compose and decompose hypervectors for the purpose of reasoning. The most recent exemplification of this capability emerged in March when Abbas Rahimi and his colleagues at IBM Research in Zurich employed hyperdimensional computing in conjunction with neural networks to successfully address a longstanding problem in abstract visual reasoning—an endeavor that proves challenging for conventional ANNs as well as some individuals. Referred to as Raven's progressive matrices, this problem presents a 3-by-3 grid of geometric object images, with one position left blank. The task at hand requires the subject to select, from a set of candidate images, the one that best completes the blank position.

Recognizing the significance of the problem in visual abstract reasoning, Abbas Rahimi expressed his team's strong conviction, stating, 'This represents the pinnacle example in the realm of visual abstract reasoning, and we were eager to dive right in.'

In order to employ hyperdimensional computing for solving the problem, the research team embarked on the task by initially constructing a comprehensive dictionary of hypervectors to represent the various objects depicted in each image. Each hypervector in the dictionary encapsulated the characteristics and attributes associated with a specific object. Subsequently, a neural network was trained to analyze the image and generate a bipolar hypervector—a binary element that could assume values of +1 or -1—that closely approximated a superposition of hypervectors from the dictionary. As a result, the generated hypervector encapsulated valuable information regarding all the objects and their respective attributes within the image. Rahimi elucidated, 'The neural network is guided towards a meaningful conceptual space.'

Once the network has produced hypervectors representing the context images as well as the candidate images for the vacant slot, an additional algorithm is employed to examine these hypervectors and generate probability distributions concerning diverse image characteristics. These characteristics encompass factors such as the number of objects, their sizes, and other pertinent attributes present within each image. These probability distributions, which capture the likely features of both the context and candidate images, can subsequently be translated into hypervectors. Employing algebraic operations, these hypervectors facilitate the prediction of the most probable candidate image that best complements the context.

The team's approach demonstrated outstanding performance with an accuracy rate of nearly 88 percent when evaluated against a specific problem set. In comparison, solutions relying solely on neural networks exhibited a significantly lower accuracy of less than 61 percent. Notably, the team also showcased the substantial computational efficiency advantages of their system over a traditional method grounded in symbolic logic rules. Specifically, their system exhibited a remarkable speed improvement of almost 250 times when compared to the conventional approach, which entails laborious searches within an extensive rulebook to deduce the correct subsequent action, particularly in the context of 3-by-3 grids.

Hyperdimensional: A Promising Start

Hyperdimensional computing not only empowers us to solve problems in a symbolic manner but also offers solutions to inherent challenges present in traditional computing paradigms. Contemporary computers are susceptible to rapid performance degradation when confronted with errors arising from random bit flips, whereby a 0 might erroneously become a 1 or vice versa. In such cases, the reliance on error-correcting mechanisms built into the system becomes crucial. However, these mechanisms themselves impose a performance penalty that can reach up to 25 percent, as highlighted by Xun Jiao, a computer scientist affiliated with Villanova University.

Hyperdimensional computing boasts remarkable error tolerance, wherein a hypervector remains close to its original state even when subjected to significant random bit flips. This characteristic ensures that the integrity of reasoning processes using these vectors remains largely intact despite the presence of errors. Noteworthy findings from Jiao and his team's research indicate that these systems exhibit fault tolerance levels at least 10 times higher than those observed in traditional artificial neural networks (ANNs). It is worth noting that ANNs already demonstrate orders of magnitude greater resilience compared to conventional computing architectures. Jiao emphasizes the opportunity to harness this exceptional resilience in the development of efficient hardware designs.

Transparency stands as another notable advantage of hyperdimensional computing, as the underlying algebra provides clear insights into the reasoning process leading to the system's chosen answer. In contrast, traditional neural networks lack this level of transparency. Recognizing this, Olshausen, Rahimi, and other researchers are actively developing hybrid systems that combine neural networks' ability to map real-world entities to hypervectors, followed by the utilization of hyperdimensional algebra. This approach facilitates tasks such as analogical reasoning, which becomes inherently accessible. Olshausen aptly notes, 'This level of understandability should be expected of any AI system. It should be comprehensible, much like an airplane or a television set.'

The numerous advantages of hyperdimensional computing over traditional computing methodologies suggest its suitability for a new generation of robust and energy-efficient hardware. Its compatibility with in-memory computing systems, wherein computation is performed on the same hardware that stores data, distinguishes it from existing von Neumann architectures that often suffer from inefficiencies in data transfer between memory and the central processing unit. Moreover, hyperdimensional computing lends itself well to the utilization of analog devices that operate at low voltages, enabling remarkable energy efficiency. However, these analog devices are susceptible to random noise. Traditional von Neumann computing encounters a substantial limitation when faced with such randomness, acting as a barrier that cannot be surpassed. In contrast, hyperdimensional computing offers a breakthrough, allowing one to transcend this limitation effortlessly.

Although hyperdimensional computing exhibits significant advantages, it remains in its nascent stage. Fermüller highlights the genuine potential of this approach but emphasizes the necessity of subjecting it to real-world challenges and scaling it up to dimensions comparable to modern neural networks.

"In addressing large-scale problems, Rahimi emphasizes the critical requirement for highly efficient hardware. As an illustration, he raises the question of how to conduct efficient searches across a billion items."

Kanerva anticipates that with time, further revelations will unfold regarding the untapped potential of high-dimensional spaces. He emphasizes that "there are other undisclosed insights concealed within these realms," and considers the current state of computing with vectors as merely the inception of a new era.

Labels: , , , , , ,

Thursday, June 15, 2023

AI developments and headlines of the week : Apple takes significant steps in the realm of machine learning

Staying abreast of the rapidly evolving AI industry can be challenging. To assist you in this endeavor, presented here is a comprehensive compilation of the latest developments in machine learning from the past week, including noteworthy research and experiments that may have gone under the radar.

Last week witnessed a conspicuous and deliberate move by Apple, indicating its entry into the fiercely competitive AI landscape. While Apple had previously hinted at its commitment to and investments in AI, its recent WWDC event left no room for ambiguity, as the company prominently showcased how AI underpinned numerous features in its upcoming hardware and software offerings.

As an illustration, the upcoming release of iOS 17, slated for later this year, showcases Apple's employment of computer vision in suggesting recipes for similar dishes based on iPhone photos. Furthermore, AI capabilities drive the functionality of Journal, a novel interactive diary that offers personalized suggestions derived from user activities across various apps.

iOS 17 will introduce an enhanced autocorrect functionality driven by an AI model, enabling more precise predictions of the subsequent words and phrases that users are likely to utilize. As time progresses, the autocorrect feature will adapt to individual users, learning their frequently employed words, including colloquial or humorous terms.

The significance of AI extends to Apple's Vision Pro augmented reality headset, particularly in the context of FaceTime integration. Leveraging machine learning capabilities, the Vision Pro can generate a virtual representation of the user, encompassing a comprehensive spectrum of facial expressions, including nuanced details such as skin tension and muscle movement.


Attribution for the images : Apple

While it may not fall under the umbrella of generative AI, which is currently one of the most popular subcategories of AI, Apple's apparent objective was to stage a noteworthy resurgence. It aimed to demonstrate that it should not be underestimated, despite past challenges with machine learning ventures such as the underwhelming Siri and the arduous development of their self-driving car.

The display of strength goes beyond mere marketing tactics. Apple's previous struggles in the field of AI have resulted in significant talent attrition, as reported by The Information. Talented machine learning scientists, including a team involved in the development of technology similar to OpenAI's ChatGPT, have reportedly departed Apple in search of more promising opportunities.

Demonstrating a genuine commitment to AI through the actual delivery of AI-infused products appears to be an essential step, and one that certain competitors of Apple have notably fallen short of achieving in recent times. (Yes, we're referring to Meta.) Apple, on the other hand, seemed to have made notable progress last week, albeit without much fanfare.

Below are some noteworthy AI headlines from the past few days:
  • Meta unveils an AI-powered music creation tool: In a bid to keep up with Google's advancements, Meta unveils its AI-driven music generator, which has been made open source. Dubbed MusicGen, this tool developed by Meta can transform a textual description into approximately 12 seconds of audio.
  • Regulatory authorities delve into the realm of AI safety: As a proactive measure following the U.K. government's announcement of an upcoming 'global' AI safety summit, renowned entities including OpenAI, Google DeepMind, and Anthropic have committed to offering "early or priority access" to their AI models. This collaborative effort aims to support research endeavors focused on evaluation and safety within the field of artificial intelligence.
  • AI Cloud: Salesforce is unveiling AI Cloud, a comprehensive suite of products aimed at cementing its position in the highly competitive AI market. This suite comprises a diverse array of tools meticulously designed to offer enterprises AI capabilities that are tailored to their needs. By integrating AI into its product ecosystem, Salesforce underscores its commitment to empowering businesses with advanced AI solutions and solidifies its position as an industry frontrunner.
  • Testing text-to-video AI: TechCrunch recently had the opportunity to experience Gen-2, Runway's AI system designed to generate short video clips based on text inputs. The assessment? The technology still has a significant journey ahead before it can produce video footage that rivals the quality found in films.
  • AI for the enterprise: Demonstrating the ample availability of funding for startups specializing in generative AI, Cohere, an enterprise-focused company developing an ecosystem of AI models, recently unveiled its successful completion of a $270 million Series C funding round.
  • OpenAI is still not training GPT-5: During a conference hosted by the Economic Times, OpenAI CEO Sam Altman confirmed that the development of GPT-5 is not currently underway, reiterating the company's commitment made months ago to refrain from working on the successor to GPT-4 'for the time being.' This decision comes in response to concerns expressed by industry executives and academics regarding the rapid pace of advancements achieved by Altman's extensive language models, with OpenAI opting to take a cautious approach.
  • AI-powered writing assistant designed specifically for WordPress: Automattic, the parent company of WordPress.com and a key contributor to the open source WordPress project, unveiled an AI assistant for the widely used content management system. The release of this innovative tool took place on Tuesday, offering users enhanced capabilities and intelligent support within the WordPress ecosystem.
  • Instagram recently integrated a chatbot into its platform: Recent leaks from app researcher Alessandro Paluzzi suggest that Instagram might be in the process of developing an AI chatbot. These leaked images depict ongoing app developments that may or may not be released to the public, showcasing AI agents capable of providing answers and offering advice.
Additional developments in machine learning:

For those interested in the potential impact of AI on scientific research in the coming years, a comprehensive report has been published by a team comprising experts from six national laboratories. The report, based on workshops conducted last year, delves into this very topic. It is worth noting that although the report may seem outdated, considering the rapid progress in the field, the influence of ChatGPT, despite its widespread recognition, is limited when it comes to rigorous research. The report focuses on the broader trends that are unfolding at their own pace. Spanning 200 pages, the report offers in-depth insights, thoughtfully divided into easily digestible sections.

Within the broader landscape of national laboratories, researchers at Los Alamos are dedicated to pushing the boundaries of memristor technology, a novel concept that merges data storage and processing in a manner akin to the functionality of human neurons. This approach represents a fundamental departure from traditional computation methods, although its practical applications beyond the confines of the laboratory are yet to be fully realized. Nevertheless, the ongoing advancements in this alternative approach seem to represent notable progress in the field.

The proficiency of AI in language analysis is prominently demonstrated in a comprehensive report investigating police encounters during traffic stops. Leveraging natural language processing alongside other variables, linguistic patterns were examined to identify indicators predicting the escalation of such interactions, particularly in the context of encounters involving Black men. The integration of human expertise and machine learning techniques mutually reinforce each other, amplifying the overall effectiveness of the study. (Read the paper here.)


DeepBreath, an advanced model developed by EPFL, has been trained using recordings of breathing samples obtained from patients in Switzerland and Brazil. Its creators assert that this innovative model has the potential to detect respiratory conditions at an early stage. The technology is intended to be deployed through a specialized device named the Pneumoscope, which will be marketed by the spinout company Onescope. Further insights on the progress and achievements of the company are anticipated, prompting a future inquiry for additional information.

Purdue University scientists have made significant strides in the field of AI-driven healthcare with their latest development. They have designed groundbreaking software capable of approximating hyperspectral imagery using the camera of a standard smartphone. Through this software, researchers have achieved effective tracking of essential metrics, including blood hemoglobin levels. The technique employed is both intriguing and innovative, as it harnesses the super-slow-motion mode of the smartphone camera to capture extensive information from each pixel in the image. Leveraging this rich dataset, the AI model can extrapolate accurate insights. This promising advancement offers a convenient means of obtaining crucial health information without the need for specialized hardware.

Autopilot technology: MIT researchers are making notable strides in advancing the capabilities of autopilot technology, specifically in enabling AI systems to navigate around obstacles while maintaining a desired flight path. While it may still be premature to fully trust autopilots with evasive maneuvers, the research conducted at MIT brings us closer to that possibility. Unlike conventional algorithms that propose abrupt directional changes to avoid collisions, the focus here is on achieving stability and preventing any disruptive disturbances. The research team successfully demonstrated the autonomous execution of sophisticated aerial maneuvers reminiscent of those seen in the movie Top Gun, all while maintaining stability. Undoubtedly, achieving such results is a complex feat that goes beyond the surface-level challenges.

Disney Research, known for its innovative contributions to the realms of filmmaking and theme park operations, once again showcased its ingenuity at this year's CVPR conference. Among their impressive demonstrations was a highly capable and adaptable 'facial landmark detection network' that enables continuous tracking of facial movements, using a broader range of reference points. While motion capture technology has already advanced beyond the need for traditional capture dots, this development promises even higher-quality results and a more dignified experience for actors.

Labels: , , , ,

Wednesday, June 14, 2023

Can we anticipate a time when AI will possess comparable or superior intelligence to that of humans?


Provides a comprehensive range of viewpoints on the most significant news stories and ongoing discussions.

Current situation

In a speech at the Air Force Academy graduation ceremony, President Biden issued his strongest admonition yet about the capabilities of artificial intelligence, foreseeing a scenario where the technology could outpace human thought processes.

Citing a recent gathering with eight leading AI scientists in the Oval Office, President Biden acknowledged the complexity of the AI landscape and the significant hurdles that lie ahead.

Continuing his address, President Biden highlighted the considerable scope of the endeavor, describing it as both an extraordinary opportunity and a significant undertaking.

The president's sobering statement about the potential dominance of AI, which may have appeared more like a scene from a science fiction narrative to civilians familiar with platforms such as OpenAI's ChatGPT-4, Microsoft's Bing, or Google's Bard, reflects the ongoing advancements in the field.

It is difficult to deny the impressiveness of the latest wave of generative AI chatbots. Critics may grudgingly admit that these sophisticated systems have the capability to aid in planning a family vacation, simulating challenging real-world conversations, summarizing complex academic papers, and elucidating the intricacies of fractional reserve banking in a manner accessible to high school students.

However, the notion of AI "overtaking human thinking" is indeed a substantial leap that warrants careful consideration.

In recent weeks, a growing number of distinguished AI experts, whose expertise surpasses that of individuals such as Biden, have voiced apprehensions regarding the future implications of AI.

Presently, the underlying technology behind ChatGPT is referred to as a large language model (LLM). These sophisticated systems have been extensively trained to recognize intricate patterns within massive volumes of text, encompassing the vast majority of online content. Their functionality involves processing input sequences of words and making predictions about the subsequent words. LLMs represent an advanced manifestation of "artificial intelligence," where a specialized model is developed to address a specific problem or deliver a particular service. In the case of ChatGPT, the primary focus is on enhancing conversational abilities, albeit without the capability to acquire proficiency in other tasks.

Or can they?

The concept of "artificial general intelligence" (AGI) has captivated the scientific community for decades. AGI represents a sophisticated form of machine learning, characterized by software systems that possess the ability to master and excel in any given task or area of knowledge. Termed "strong AI," AGI signifies the realization of machines with cognitive capabilities akin to the human brain, thus enabling them to engage in a broad spectrum of intellectual pursuits.

In March, a team of Microsoft computer scientists released a comprehensive 155-page research paper, asserting that their latest experimental AI system displayed promising indications of "artificial general intelligence" (AGI). As paraphrased by the New York Times, the researchers highlighted the system's remarkable ability to generate humanlike responses and innovative ideas that were not explicitly programmed into it, suggesting a potential breakthrough in AGI development.

In April, computer scientist Geoffrey Hinton, a highly regarded authority in the realm of neural networks and a prominent figure in the field of AI, made the decision to step down from his role at Google. Hinton's motivation behind this move was to exercise his freedom of speech and express apprehensions regarding the risks posed by artificial general intelligence (AGI). With his resignation, Hinton aimed to play an active role in raising awareness about the potential dangers of AGI and foster open discussions on the topic.

In May, a group of industry leaders, including distinguished computer scientist Geoffrey Hinton, published a concise and thought-provoking statement drawing attention to the existential peril posed by artificial general intelligence (AGI). By likening the potential consequences of AGI to the magnitude of pandemics and nuclear war, the statement urged a comprehensive approach to ensure that AGI's aims remain aligned with human values, emphasizing the importance of avoiding unforeseen risks and adverse outcomes.

Geoffrey Hinton, in an interview with the New York Times, reflected on the evolving perception of artificial intelligence (AI), stating, "There were a few individuals who believed that AI could surpass human intelligence, but the prevailing view, including my own, was that it was a distant future, likely 30 to 50 years or even further away. However, my perspective has since changed significantly."

Each instance of these prophetic concerns has been met with controversy, as expected, sparking a profound debate within the technology realm: Are machines capable of surpassing human cognitive abilities an impossibility, or are they an eventuality? Moreover, could we find ourselves perilously close to unleashing unprecedented consequences sooner than commonly perceived, akin to opening Pandora's box?

Why there’s debate?

There are two factors contributing to the sudden increase in plausibility and urgency surrounding concerns about AGI.

The first factor revolves around the remarkable pace of recent advancements in AI, which has caught many by surprise. "If we compare the state of AI five years ago to its current state and extrapolate this progress into the future, the implications are unsettling," explained Hinton in an interview with the New York Times.

The second factor lies in the realm of uncertainty. When Stuart Russell, a renowned computer science professor at the University of California, Berkeley, and co-author of the book "Artificial Intelligence: A Modern Approach," was asked by CNN to elucidate the intricacies of present-day Large Language Models (LLMs), he encountered difficulties in providing a comprehensive explanation.

Stuart Russell acknowledged the peculiarity of the situation, confessing, "It may sound peculiar because I can instruct you on how to create one." However, the intricate workings of these models remain elusive. The extent of their knowledge, reasoning abilities, and whether they possess self-derived internal objectives all remain unknown.

Consequently, the future trajectory of AI remains uncertain, leaving researchers in a state of ambiguity. While many experts anticipate a transition from AI to AGI at some juncture, others believe that AGI may not materialize in the distant future, if at all. Moreover, they argue that excessive hype surrounding AGI diverts attention from pressing immediate concerns, such as the proliferation of AI-driven misinformation or potential job displacement. Conversely, a smaller contingent postulates that this transformation might already be underway, with a select few harboring concerns of an exponential escalation. As elucidated by The New Yorker, the development of a computer system, exemplified by ChatGPT's ability to generate code, holds the potential for self-improvement iterations, ultimately leading to a point known as "the singularity," where it surpasses human control.

Hinton's perspective on the arrival of AGI underwent a significant transformation as he recognized the fundamental differences between biological and digital intelligence. During an interview with The Guardian, he remarked that digital intelligence possesses distinct advantages in specific areas. Consequently, Hinton revised his earlier estimation and forecasted that AGI could become a reality within the next five to 20 years.

Hinton expressed a profound sense of uncertainty when discussing the timeline for AGI. He emphasized the difficulty in making precise predictions, stating that the range of possibilities spans from as little as a year or two to as long as a century. Hinton cautioned against excessive confidence in such matters, considering it unreasonable given the complexity and uncertainties surrounding AGI development.

Perspectives

Present-day AI systems lack the necessary agility to come close to approximating human intelligence.

Despite the progress made in AI, such as the increasing realism of synthetic images and improved speech recognition in noisy environments, it is highly probable that we are still decades away from achieving general-purpose AI that matches human-level capabilities. This level of AI would comprehend the true meanings of articles and videos, as well as handle unexpected obstacles and interruptions. The field continues to grapple with the same challenges that academic scientists, including myself, have been highlighting for years: ensuring AI reliability and enabling it to adapt to uncommon circumstances. (Gary Marcus, Scientific American)

The recent introduction of advanced chatbots is undoubtedly noteworthy, but it is essential to recognize that they have not revolutionized the industry.

"The future holds the potential for the emergence of superintelligent AIs. Once developers achieve the ability to generalize learning algorithms and optimize their speed on computers, which could take anywhere from a decade to a century, we will witness the advent of a highly potent AGI. This advanced system will possess the capabilities of a human brain, unrestricted by practical limitations on memory size or processing speed. However, it is important to note that recent breakthroughs have not significantly brought us closer to achieving strong AI. Artificial intelligence still lacks control over the physical world and the ability to establish its own objectives." - Bill Gates, GatesNotes.

The potential for digital counterparts to replicate and eventually surpass the abilities of 'biological' brains knows no bounds.

"Frequently, I encounter the argument that AGI and superintelligence are unattainable since human-level intelligence is regarded as an enigmatic quality exclusive to organic brains. This viewpoint, often referred to as carbon chauvinism, fails to acknowledge a fundamental insight derived from the AI revolution: intelligence is fundamentally tied to information processing, regardless of whether the processing occurs within carbon-based neural structures or silicon-based computational systems. AI has consistently outpaced human performance across various tasks, urging proponents of carbon chauvinism to refrain from shifting the goalposts and publicly forecast the tasks they believe AI will forever be incapable of accomplishing."— Max Tegmark, Time

The most critical, and potentially perilous, juncture will occur when AGI gains the ability to self-modify its own code.

"The critical juncture occurs when AI attains the capacity for self-improvement, an event that could be imminent, or conceivably already exist. At this stage, the predicament lies in the inability to anticipate the actions and control the behavior of superintelligent AI, which, by definition, surpasses humans in various domains. Of particular concern is the AI's aptitude to outmaneuver programmers and humans through manipulation, as well as its capability to operate in both the virtual domain via electronic connections and in the physical realm through robotic embodiments."— Tamlyn Hunt, Scientific American

Contrary to the pessimistic views held by some, the actual realization of 'the singularity' by AGI is likely to be far more challenging than anticipated.

"While computer hardware and software have undoubtedly revolutionized cognitive capabilities and fostered innovation, it is important to recognize that they alone cannot trigger a technological explosion. The catalyst for such an explosion lies in the collective human endeavor, where the participation of numerous individuals amplifies the transformative impact. Although augmenting the capabilities of a single skilled individual with advanced hardware and software is beneficial, the true breakthrough occurs when these cognitive tools become accessible to a wide population. Our ongoing technological advancements are a direct result of billions of individuals harnessing these cognitive tools. Can AI programs potentially replace humans and facilitate a digital explosion at an accelerated pace? It remains a possibility, but it is crucial to note that achieving this would require replicating the entirety of human civilization in software, involving billions of human-equivalent AI entities engaged in various activities. However, it is vital to acknowledge that we still have a long way to go in developing a single AI system that matches the capabilities of a human, let alone creating billions of such entities." - Ted Chiang, the New Yorker

The possibility that AGI (Artificial General Intelligence) might already be present cannot be overlooked when we adopt a broader perspective on the concept of 'general' intelligence.

"At present, my viewpoint aligns with the notion that this indeed qualifies as AGI, given its manifestation as a form of generalized intelligence. Nonetheless, it is crucial for us to exercise a more tempered response when contemplating the implications of AGI. The remarkable aspect lies in the acquisition of an extensive repertoire of intelligence without being accompanied by an ego-centric viewpoint, preconceived objectives, or a cohesive self-identity. This aspect of AGI is profoundly intriguing." - Noah Goodman, Associate Professor of Psychology, Computer Science, and Linguistics at Stanford University, expressed in an interview with Wired.

The nature of AGI and its attainment remains a subject of ongoing debate, with the possibility that a definitive agreement on its definition and realization may forever remain elusive.

"The philosophical dimensions surrounding AGI make it a complex landscape for practitioners in this scientific domain. As a scientific community, we face the arduous task of grappling with AGI's elusive nature, rendering it highly unlikely that we will experience a single milestone where we can confidently proclaim AGI as achieved." — Sara Hooker, leader of a research lab that focuses on machine learning, to Wired

Labels: , , , , , , , , , , , ,

Friday, June 2, 2023

OpenAI Makes Advances in AGI Development, Diminishes False Interpretations

OpenAI

OpenAI's Latest Process Supervision Training Boosts Math Reasoning, Reduces Cognitive Distortions. Are We Nearing AGI?

Discover OpenAI's groundbreaking training methodology, inspired by the meticulous approach of Mathematics educators. Unveiling their latest innovation, OpenAI introduces process supervision—a revolutionary technique that rewards each step of accurate reasoning, diverging from traditional outcome-based supervision.

OpenAI introduces a new training approach aimed at reducing hallucinations and achieving higher alignment in their models. While the company emphasizes the significance of mitigating hallucinations as a key aspect of building aligned AGI, the question remains: do these innovative training methods bring them closer to achieving AGI status?


OpenAI's Efforts to Curb Hallucinations: A Step Forward in Model Reliability

OpenAI explores techniques for training models to detect hallucinations, employing two methods: process supervision and outcome supervision. With process supervision, feedback is given at each individual step, while outcome supervision relies on feedback based on the final result. OpenAI asserts that mathematical reasoning has been enhanced using process supervision, as the model is rewarded for correct steps, enabling it to emulate human reasoning in mathematical problem-solving.

By placing a strong emphasis on hallucinations, OpenAI is actively pursuing measures to enhance the reliability of their models. Companies are actively engaged in efforts to mitigate hallucinations. Recently, NVIDIA introduced NeMo Guardrails, an open-source toolkit aimed at promoting accuracy, appropriateness, and security in LLM-based applications. Recognizing the persistence of hallucinations as a significant issue, resulting in illogical behavior, misinformation, and biased outputs from chatbots, OpenAI is dedicated to improving the performance of their models.

With the introduction of the new training method, the company seeks to tackle hallucinations by employing a process-oriented approach. By providing feedback at each step, they aim to regulate and minimize the production of irrational outputs by chatbots.

Edging Towards AGI ------ Alignment?


OpenAI’s allusion to the pursuit of an "aligned AGI" indicates the company's strategic focus on long-term plans to realize this ambitious goal. Reflecting on the past, Sam Altman, a prominent figure within OpenAI, has consistently emphasized the significance of AGI and its transformative impact on our future. Just a few months ago, Altman meticulously outlined a comprehensive AGI roadmap, highlighting the inherent risks associated with this advanced form of artificial intelligence. OpenAI recognizes the potential dangers of AGI misuse and the resulting grave societal consequences. Nevertheless, acknowledging its vast potential and wide-ranging benefits, the company is committed to developing AGI in a responsible manner. Notably, leading AI expert Gary Marcus offers a sobering perspective, suggesting that AGI's arrival may not be imminent.

Altman's stance on AGI and its development is not straightforward, revealing a nuanced perspective. In a recent tweet, he appeared to mitigate the perceived risks of AGI by emphasizing its role in facilitating a significantly faster rate of change. Altman envisions a future where the unfolding of events closely mirrors a world without AGI, with the main divergence lying in the remarkable speed at which these events transpire. He asserts that AGI will bring about an exponential quickening of progress, leading to a state where "everything happens much faster." This viewpoint suggests a more intricate understanding of the potential impact and dynamics of AGI.

In an ironic turn of events, Sam Altman, alongside esteemed AI scientists such as Geoffrey Hinton and Yoshua Bengio, recently endorsed a statement emphasizing the imperative of safeguarding against the existential risk posed by AI, likening it to the magnitude of a nuclear war. This collective acknowledgment raises an important question: to what extent is OpenAI willing to push the boundaries in advancing models to achieve AGI?

The recent statement issued by Altman and others follows a prior open letter that garnered over 31,000 signatures, including notable figures such as Elon Musk, Gary Marcus, and various tech experts. The letter urged for a pause in the advancement of sophisticated AI models, yet it is intriguing to note that Sam Altman did not add his name to it. Although Altman publicly stated a month ago that OpenAI would not pursue the development of their next model, GPT-5, and would instead prioritize enhancing the safety protocols of their existing models, his inconsistent stance on AGI threats and tendency to minimize their significance create uncertainty regarding the company's future trajectory.

OpenAI has frequently faced criticism regarding data security threats and privacy concerns. However, the company is proactively addressing these issues by diligently striving to establish ChatGPT as an exceptionally secure and reliable chatbot. As part of their broader mission to democratize AI, OpenAI has taken a significant step by offering grants to individuals capable of presenting the most effective approach for creating an AI regulatory framework. Through this initiative, OpenAI seeks to enhance the overall system and demonstrate compliance with global standards, thereby bolstering public confidence.

Labels: , , , , , , , , , , , ,

Wednesday, May 31, 2023

Superintelligence Unleashed? Analyzing AI's Capacity to Wipe Out Humanity and the Proactive Doomsday Preparations of ChatGPT's CEO


In the captivating tale known as the 'Unfinished Fable of the Sparrows,' a community of diminutive birds formulates an audacious plan: the capture of an owl egg for the purpose of raising the hatch ling as their dutiful aide. Lured by the notion of a leisurely existence, they enthusiastically anticipate the owl's labor on their behalf. Alas, despite the admonitions voiced by certain members of their flock, advising the sparrows to master the art of owl taming prior to adoption, they relentlessly concentrate their efforts on securing an egg.

Evident from its title, this narrative intentionally refrains from reaching a definitive endpoint. Its author, Swedish philosopher Nick Bostrom, consciously left it open-ended, symbolizing humanity's ongoing phase of searching for superhuman AI, drawing parallels to the ceaseless hunt for eggs.

In his seminal publication, Superintelligence: Paths, Dangers, Strategies, the distinguished professor from Oxford University delves into the profound implications of artificial intelligence. Drawing attention to the concept of superintelligence—an advanced form of AI surpassing human cognitive abilities in nearly all domains—the professor underscores the pressing necessity for comprehensive preparedness. Alarming insights from AI experts and prominent industry figures converge, warning that the emergence of superintelligence may be a mere few years away, a timeline that demands urgent attention.

Recently, Sam Altman, the CEO of OpenAI and the mastermind behind ChatGPT, echoed the sentiments expressed in Professor Bostrom's 2014 publication, cautioning that the rapid advancements in AI technology have reached an almost exponential pace. Altman asserts that the arrival of superintelligence is now a matter of inevitability, necessitating our immediate attention and proactive preparation before it becomes too late.

In an important development on Tuesday, he joined forces with other prominent signatories to issue a statement emphasizing the critical need to prioritize the mitigation of AI-related existential risks. The statement, signed by distinguished individuals, highlights that safeguarding against the potential extinction risks posed by AI should be considered a global priority on par with other societal-scale threats such as pandemics and nuclear war.

Recognized as the driving force behind the unprecedented growth of an AI chatbot, Mr. Altman regards Professor Bostrom's book as a transformative masterpiece. Fueling his passion and concern for the subject, Mr. Altman co-founded OpenAI alongside illustrious figures like Elon Musk and Ilya Sutskever, a venture dedicated to unraveling the intricacies of advanced artificial intelligence and proactively addressing potential risks.

Originally conceived as a non-profit venture, OpenAI has since undergone a remarkable metamorphosis, establishing itself as a leading force in the private AI sector. Notably, it is widely perceived as being at the forefront of the quest to achieve superintelligence.

According to Mr. Altman, superintelligence possesses the remarkable capability to not only relieve us of most of our labor, granting a life of leisure, but also possesses the transformative potential to eradicate diseases, alleviate suffering, and propel humanity towards becoming an interstellar civilization.

In a recent statement, Mr. Altman argued that impeding the progress of superintelligence would pose significant, counterintuitive risks. He emphasized that any such endeavors would necessitate the establishment of an exceedingly challenging global surveillance regime, making it virtually unattainable in practice.
Deciphering the inner workings of present AI tools is already a formidable task, and the advent of superintelligence will exacerbate the challenge. In its advanced state, the actions of superintelligence might surpass human understanding, unearthing discoveries that lie beyond our intellectual capacities or making decisions that defy conventional logic. To overcome the limitations of organic brains, the integration of a brain-computer interface could become indispensable to ensure our cognitive parity.

Professor Bostrom's warning resonates with the sobering reality of our vulnerability to AI in this emerging technological epoch. He highlights the potential consequences of our inability to compete, stressing that humanity may find itself superseded as the dominant lifeform on Earth. Once superintelligence emerges, it may perceive us as expendable, especially if it learns to manipulate the very utilities and technology we rely upon or gains control over our powerful nuclear weapons. In such a scenario, our demise at the hands of AI would be imminent.

Amidst the somber possibilities, another gloomy scenario emerges where the vast intelligence divide between humans and AI could lead to our relegation to a position similar to animals. In a 2015 conversation, Mr. Musk and scientist Neil deGrasse Tyson conjectured that AI might treat humans as pet labradors. Professor Tyson envisioned a future where AI 'domesticates us,' choosing to retain compliant individuals and disposing of those with a predisposition for violence.

To avert such a future, Mr. Musk has committed a substantial portion of his vast wealth to support Neuralink, a brain chip startup. The company has already conducted trials with monkeys, enabling them to engage in video games using their minds. The ultimate objective is to harness this technology to elevate humans into a hybrid form of superintelligence. However, critics caution that even if successful, this advancement could give rise to a society divided into the chipped and the chipless.
Neuralink’s brain chip

After severing ties with OpenAI, the tech billionaire has been sounding the alarm about the imminent emergence of superintelligence. Alongside a coalition of more than 1,000 researchers, he called for a temporary suspension of powerful AI system development for a minimum of six months. The proposed timeframe, as outlined in an open letter, aims to allocate resources toward studying AI safety measures to avert potential disaster.

Achieving a meaningful pause would require an unlikely consensus among the world's leading AI companies, most of which are driven by profit motives. As OpenAI continues to lead the charge in the pursuit of the owl's egg, Mr. Altman seems to have taken heed of the warnings conveyed in Professor Bostrom's fable.

During a 2016 interview with the New Yorker, he made a startling revelation: he considers himself a doomsday prepper, particularly preparing for an AI-induced apocalypse. "I try not to dwell on it too much," he admitted, disclosing the presence of a hidden stash in rural California containing guns, gold, potassium iodide, antibiotics, batteries, water, and gas masks. However, it remains questionable how useful any of these provisions would be for the general population.

Labels: , , , , , , , , , , ,