Your commit message

.github/workflows/update_readme.yml

@@ -0,0 +1,34 @@
+name: Update README
+
+on:
+  push:
+    paths:
+      - '.src/documentation/PROJECT.md'
+      - '.src/documentation/CODE_OF_CONDUCT.md'
+      - '.src/documentation/CONTRIBUTING.md'
+
+jobs:
+  update-readme:
+    runs-on: ubuntu-latest
+
+    steps:
+    - name: Checkout repository
+      uses: actions/checkout@v2
+
+    - name: Combine markdown files
+      run: |
+        cat .src/documentation/PROJECT.md > README.md
+        echo -e "\n\n" >> README.md
+        cat .src/documentation/INSTALL.md > README.md
+        echo -e "\n\n" >> README.md
+        cat .src/documentation/CODE_OF_CONDUCT.md >> README.md
+        echo -e "\n\n" >> README.md
+        cat .src/documentation/CONTRIBUTING.md >> README.md
+
+    - name: Commit and push if changed
+      run: |
+        git config --global user.email "[email protected]"
+        git config --global user.name "GitHub Action"
+        git add README.md
+        git commit -m "Update README" || exit 0
+        git push

README.md

@@ -1,10 +1,154 @@
+# Introducing 🧪👩🏻‍🔬Sci-Tonic - Your Ultimate Technical Research Assistant 🚀
+
+### Welcome to the Future of Technical Research: Sci-Tonic 🌐
+
+In an era where data is king 👑, the ability to efficiently gather, analyze, and present information is crucial for success across various fields. Today, we are thrilled to introduce Sci-Tonic 🤖, a state-of-the-art technical research assistant that revolutionizes how professionals, researchers, and enthusiasts interact with data. Whether it's financial figures 💹, scientific articles 🧬, or complex texts 📚, Sci-Tonic is your go-to solution for turning data into insights.
+
+## Features of Sci-Tonic 🌈
+
+### 1. Data Retrieval: A Gateway to Information 🚪📊
+- **Broad Spectrum Access**: From financial reports to scientific papers, Sci-Tonic accesses a wide array of data sources.
+- **Efficiency and Precision**: Quickly fetches relevant data, saving you time and effort ⏰💼.
+
+### 2. Advanced Analysis: Deep Insights from Cutting-Edge AI 🧠💡
+- **Intelligent Interpretation**: Utilizes advanced AI algorithms to analyze and interpret complex data sets.
+- **Customizable Analysis**: Tailored to meet specific research needs, providing targeted insights 🔍.
+
+### 3. Multimedia Output: Diverse and Dynamic Presentation 📝🎥📊
+- **Versatile Formats**: Outputs range from text and infographics to video summaries.
+- **Engaging and Informative**: Enhances understanding and retention of information 🌟.
+
+### 4. User-Friendly Interface: Accessible to All 👩‍💻👨‍💻
+- **Intuitive Design**: Easy to navigate for both tech experts and novices.
+- **Seamless Experience**: Makes research not just productive but also enjoyable 🎉.
+
+### 5. Adaptive Technical Operator 🤖
+- **High Performance**: Capable of handling complex analyses with ease.
+- **On-the-Fly Adaptability**: Quickly adjusts to new data and user requests 🌪️.
+
+## Applications of Sci-Tonic 🛠️
+- **Academic Research**: Streamlines the process of gathering and analyzing scientific data 🎓🔬.
+- **Financial Analysis**: Provides comprehensive insights into market trends and financial reports 💹.
+- **Business Intelligence**: Assists in making data-driven decisions for business strategies 📈.
+- **Personal Use**: Aids enthusiasts in exploring data in their fields of interest 🌍.
+
+## Choose Sci-Tonic? 🤔
+- **Efficiency**: Saves time and effort in data collection and analysis ⏳.
+- **Accuracy**: Provides reliable and precise insights 🔎.
+- **Customization**: Adapts to specific user needs and preferences 🛠️.
+- **Innovation**: Employs the latest AI technology for data analysis 🚀.
+
+
+### Installation 📥
+```bash
+# Clone the repository
+git clone https://github.com/Tonic-AI/scitonic.git
+
+# Navigate to the repository
+cd scitonic
+
+# Install dependencies
+pip install -r requirements.txt
+
+# Run the application
+python main.py
+```
+
+## Usage 🚦
+
+1. **Installation**: Before you begin, ensure you have Sci-Tonic installed. If not, refer to our installation guide. 📥
+
+2. **Open the Application**: Launch Sci-Tonic to start your journey into data exploration. 🌐
+
+## Setting Up Your Environment 🛠️
+
+1. **Enter OpenAI API Key**: 
+   - Locate the `OpenAI API Key` textbox.
+   - Enter your API key securely. This key powers the AI models in Sci-Tonic. 🔑
+
+2. **Enter Clarifai PAT**:
+   - Find the `Clarifai PAT` textbox.
+   - Input your Clarifai Personal Access Token. This is crucial for image and audio processing functionalities. 🖼️🎙️
+
+## Describing Your Problem 📝
+
+1. **Text Input**:
+   - Use the `Describe your problem in detail:` textbox to type in your query or problem statement.
+   - Be as detailed as possible for the best results. 📃
+
+2. **Audio Input** (Optional):
+   - Click on `Or speak your problem here:` to record or upload an audio clip.
+   - Sci-Tonic will transcribe and process your spoken words. 🎤
+
+3. **Image Input** (Optional):
+   - Use `Or upload an image related to your problem:` to add an image.
+   - This can provide visual context to your query. 🖼️
+
+## Submitting Your Query 🚀
+
+- Click the `Submit` button after entering your information and query.
+- Sci-Tonic will process your inputs and start generating insights. ✨
+
+## Receiving Output 📊
+
+- The `Output` textbox will display the results, insights, or answers generated by Sci-Tonic.
+- **Scitonic produces files** so check the scitonic folder  
+- Review the output to gain valuable information related to your query. 🧐
+
+## Tips for Optimal Use 🌈
+
+- **Clear Descriptions**: The more specific your query, the better the output. 🎯
+- **Utilize Multimedia Inputs**: Leverage audio and image inputs for a more comprehensive analysis. 📸🔊
+- **Regular Updates**: Keep your API keys and tokens updated for uninterrupted service. 🔁
+
+# CONTRIBUTING GUIDE
+
+## Introduction
+Welcome to the `scitonic` repository! This guide is designed to provide a streamlined process for contributing to our project. We value your input and are excited to collaborate with you.
+
+## Prerequisites
+Before contributing, make sure you have a GitHub account. You should also join our Tonic-AI Discord to communicate with other contributors and the core team.
+
+## How to Contribute
+
+### Reporting Issues
+- **Create an Issue**: If you find a bug or have a feature request, please create an issue to report it. Use clear and descriptive titles and provide as much information as possible.
+- **Use the Issue Template**: Follow the issue template provided to ensure all relevant information is included.
+- **Discuss in Discord**: For immediate feedback or discussion, bring up your issue in the `#scitonic-discussion` channel on Discord.
+
+### Making Changes
+- **Fork the Repository**: Start by forking the repository to your own GitHub account.
+- **Create a Branch**: Create a branch in your forked repository for your proposed changes. Name the branch something relevant to the changes you're making (e.g., `feature-add-login` or `bugfix-header-alignment`).
+```bash
+git checkout -b your-branch-name
+```  
+- **Make Your Changes**: Perform the necessary changes to the codebase or documentation.
+- **Commit Your Changes**: Use meaningful commit messages that describe what you've done.
+
+```bash
+git commit -m "Your detailed commit message"
+```
+
+- **Push to Your Fork**: Push your changes to your forked repository on GitHub.
+
+```bash
+git push origin your-branch-name
+```
+
+### Submitting a Pull Request
+- **Pull Request (PR)**: Go to the original `scitonic` repository and click on "Pull Request" to start the process.
+- **PR Template**: Fill in the PR template with all the necessary details, linking the issue you're addressing.
+- **Code Review**: Wait for the core team or community to review your PR. Be responsive to feedback.
+- **Merge**: Once your PR has been approved and passes all checks, it will be merged into the main codebase.
+
+## Code of Conduct
+Please adhere to the Code of Conduct laid out in the `CODE_OF_CONDUCT.md` [file](src/documentation/CODE_OF_CONDUCT.md). Respectful collaboration is key to a healthy open-source environment.
+
+## Questions or Additional Help
+If you need further assistance or have any questions, please don't hesitate to ask in our Discord community or directly in GitHub issues.
+
+Thank you for contributing to `scitonic`!
+
 ---
-license: mit
-title: SciTonic
-sdk: gradio
-emoji: 🏆
-colorFrom: green
-colorTo: indigo
-app_file: main.py
-pinned: true
----
+
+🌟 Thank you for considering Sci-Tonic as your ultimate technical research assistant. Together, let's turn data into discoveries! 🚀🌟🔍🧬📈📊📚🤖👩‍🔬👨‍💼

eval/generate_bookmarks.ipynb

@@ -0,0 +1,175 @@
+{
+  "nbformat": 4,
+  "nbformat_minor": 0,
+  "metadata": {
+    "colab": {
+      "provenance": []
+    },
+    "kernelspec": {
+      "name": "python3",
+      "display_name": "Python 3"
+    },
+    "language_info": {
+      "name": "python"
+    }
+  },
+  "cells": [
+    {
+      "cell_type": "code",
+      "execution_count": 19,
+      "metadata": {
+        "colab": {
+          "base_uri": "https://localhost:8080/"
+        },
+        "id": "9CrIbR0AK3d1",
+        "outputId": "8624a380-d370-43b0-969c-1b21e275b322"
+      },
+      "outputs": [
+        {
+          "output_type": "stream",
+          "name": "stdout",
+          "text": [
+            "Requirement already satisfied: typing_extensions in /usr/local/lib/python3.10/dist-packages (4.9.0)\n"
+          ]
+        }
+      ],
+      "source": [
+        "# !pip install openai sentence-transformers\n",
+        "# !pip install langchain\n",
+        "!pip install typing_extensions\n"
+      ]
+    },
+    {
+      "cell_type": "code",
+      "source": [
+        "import os\n",
+        "import openai\n",
+        "from langchain_community.document_loaders import TextLoader, PyPDFLoader, CSVLoader, DirectoryLoader\n",
+        "from transformers import AutoModel\n",
+        "from langchain_community.embeddings.sentence_transformer import (\n",
+        "    SentenceTransformerEmbeddings,\n",
+        ")\n",
+        "from langchain_community.vectorstores import Chroma\n",
+        "import torch\n",
+        "import json"
+      ],
+      "metadata": {
+        "id": "xOFM83MoLQ-B"
+      },
+      "execution_count": 20,
+      "outputs": []
+    },
+    {
+      "cell_type": "code",
+      "source": [
+        "from google.colab import drive\n",
+        "drive.mount('new_articles')"
+      ],
+      "metadata": {
+        "colab": {
+          "base_uri": "https://localhost:8080/"
+        },
+        "id": "WMvNDl83M7Xb",
+        "outputId": "d59ab804-42ce-4b10-fee6-f01f19d60b38"
+      },
+      "execution_count": 53,
+      "outputs": [
+        {
+          "output_type": "stream",
+          "name": "stdout",
+          "text": [
+            "Drive already mounted at new_articles; to attempt to forcibly remount, call drive.mount(\"new_articles\", force_remount=True).\n"
+          ]
+        }
+      ]
+    },
+    {
+      "cell_type": "code",
+      "source": [
+        "def document_loader(directory):\n",
+        "  documents = {}\n",
+        "  for filename in os.listdir(directory):\n",
+        "    file_path = os.path.join(directory, filename)\n",
+        "    if filename.endswith(\".csv\"):\n",
+        "      loader = CSVLoader(file_path)\n",
+        "    elif filename.endswith(\".pdf\"):\n",
+        "      loader = PyPDFLoader(file_path)\n",
+        "    elif filename.endswith(\".txt\"):\n",
+        "      loader = TextLoader(file_path)\n",
+        "    else:\n",
+        "      break\n",
+        "\n",
+        "    document = loader.load()\n",
+        "    documents[filename] = document\n",
+        "  return (documents)\n"
+      ],
+      "metadata": {
+        "id": "QxVY8IyNL3Zp"
+      },
+      "execution_count": 54,
+      "outputs": []
+    },
+    {
+      "cell_type": "code",
+      "source": [
+        "openai.api_key = \"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\"\n",
+        "JSON_DATA = []\n",
+        "directory = \"/content/new_articles/MyDrive/new_articles\"\n",
+        "documents = document_loader(directory)\n",
+        "for filename, document in documents.items():\n",
+        "    doc = document[0].page_content\n",
+        "    # print(filename)\n",
+        "    # print(document)\n",
+        "    response = openai.chat.completions.create(\n",
+        "    model=\"gpt-3.5-turbo\",\n",
+        "    messages = [\n",
+        "    {\"role\": \"system\", \"content\": f\"Generate one Question, Answer,Reference_Article:(use {filename}), Reference_Text from(use block of text which you've used to generate answer {doc})\"},\n",
+        "  ], temperature = 0.3\n",
+        "  )\n",
+        "    #print(response)\n",
+        "    result = response.choices[0].message.content.split(\"\\n\")\n",
+        "    # print(result)\n",
+        "    json_data = {\n",
+        "    \"Question\": result[0].split(\"Question: \")[1].strip() if len(result) > 0 and \"Question:\" in result[0] else \"Not provided\",\n",
+        "    \"Answer\": result[2].split(\"Answer: \")[1].strip() if len(result) > 2 and \"Answer:\" in result[2] else \"Not provided\",\n",
+        "    \"Reference_article\": result[4].split(\"Reference_article: \")[1].strip() if len(result) > 4 and \"Reference_article:\" in result[4] else \"Not provided\",\n",
+        "    \"Reference_text\": result[6].split(\"Reference_text: \")[1].strip() if len(result) > 6 and \"Reference_text:\" in result[6] else \"Not provided\",\n",
+        "  }\n",
+        "\n",
+        "    # print(json_data)\n",
+        "\n",
+        "    JSON_DATA.append(json_data)\n",
+        "\n",
+        "with open('question_and_answer_list.json', 'w') as json_file:\n",
+        "    json.dump(JSON_DATA, json_file, indent=2)\n",
+        "\n",
+        "print(\"JSON data saved to question_and_answer_list.json\")\n",
+        "\n",
+        "print(JSON_DATA)\n"
+      ],
+      "metadata": {
+        "id": "LO9imR5SMA1u"
+      },
+      "execution_count": null,
+      "outputs": []
+    },
+    {
+      "cell_type": "code",
+      "source": [],
+      "metadata": {
+        "id": "eOAr3cy6iA9J"
+      },
+      "execution_count": 46,
+      "outputs": []
+    },
+    {
+      "cell_type": "code",
+      "source": [],
+      "metadata": {
+        "id": "E86P5xBqizsG"
+      },
+      "execution_count": null,
+      "outputs": []
+    }
+  ]
+}

eval/question_and_answer_list.json

@@ -1,63 +1,68 @@
 [
   {
-  "question": "What does Pando plan to use the $30 million raised in its recent Series B round for?",
-  "answer": "Pando intends to use the funds for expanding its global sales, marketing, and delivery capabilities.",
-  "reference_article": "Pando Raises $30M in Series B Funding for Fulfillment Management Technologies",
-  "reference_text": "Signaling that investments in the supply chain sector remain robust, Pando, a startup developing fulfillment management technologies, today announced that it raised $30 million in a Series B round, bringing its total raised to $45 million. Iron Pillar and Uncorrelated Ventures led the round, with participation from existing investors Nexus Venture Partners, Chiratae Ventures and Next47. CEO and founder Nitin Jayakrishnan says that the new capital will be put toward expanding Pando’s global sales, marketing and delivery capabilities."
-
-  },
-  {
-    "question": "What is ChatGPT, and how has it been used in various applications?",
-  "answer": "ChatGPT is a text-generating AI chatbot developed by OpenAI. It has been widely used for writing essays, code, and more based on short text prompts, enhancing productivity. Major brands have experimented with it for generating ad and marketing copy. OpenAI continually invests in ChatGPT, upgrading it to GPT-4, a more advanced language-writing model. The chatbot has been integrated into various applications, including search engines, customer service, and even an iPhone customization app called SuperChat.",
-  "reference_article": "ChatGPT: Everything you need to know about the AI-powered chatbot",
-  "reference_text": "ChatGPT, OpenAI’s text-generating AI chatbot, has taken the world by storm. It’s able to write essays, code and more given short text prompts, hyper-charging productivity. But it also has a more…nefarious side... (full article)"
-},
-  {
-  "question": "What is Checks, and how is it transitioning within Google?",
-  "answer": "Checks is an AI-powered tool developed at Google's in-house incubator Area 120 to check mobile apps for compliance with privacy rules and regulations. Originally part of Area 120, Checks is now officially moving into Google as a privacy product for mobile developers. Co-founders Fergus Hurley and Nia Castelly will hold the titles of GM and Legal Lead, respectively, for Checks under Google. The tool utilizes artificial intelligence and machine learning to scan apps and their code, identifying potential privacy and data protection rule violations. It provides suggestions for remediation, making it easier for developers to ensure compliance.",
-  "reference_article": "Google integrates AI tool Checks into its privacy-focused products",
-  "reference_text": "After Google cut all but three of the projects at its in-house incubator Area 120 and shifted it to work on AI projects across Google, one of the legacy efforts — coincidentally also an AI project — is now officially exiting to Google. Checks, an AI-powered tool to check mobile apps for compliance with various privacy rules and regulations, is moving into Google proper as a privacy product aimed at mobile developers..."
-  },
-  {
-  "question": "What acquisition has Databricks recently announced, and what is the focus of the acquired company's technology?",
-  "answer": "Databricks has recently acquired Okera, a data governance platform with a focus on AI. Okera's technology uses an AI-powered system to automatically discover, classify, and apply rules to personally identifiable information, with a particular emphasis on metadata. Additionally, Okera's isolation technology enforces governance control on arbitrary workloads without significant overhead. Databricks plans to integrate Okera's technology into its Unity Catalog, enhancing its existing governance solution for data and AI assets.",
-  "reference_article": "Databricks acquires AI-focused data governance platform Okera",
-  "reference_text": "Databricks today announced that it has acquired Okera, a data governance platform with a focus on AI. The two companies did not disclose the purchase price. According to Crunchbase, Okera previously raised just under $30 million. Investors include Felicis, Bessemer Venture Partners, Cyber Mentor Fund, ClearSky and Emergent Ventures."
-},
-  {
-"question": "What is the latest evolution in Slack's platform, particularly concerning AI, as announced at the Salesforce World Tour event?",
-"answer": "Slack has advanced from a pure communications platform to one facilitating direct integration with enterprise applications. At the Salesforce World Tour event in NYC, the company unveiled plans to place AI at the forefront of the user experience, aiming to enhance information retrieval and workflow creation. Notably, these features are still in development. The incorporation of AI into Slack involves various integrations, including SlackGPT, the company's generative AI built on the Slack platform. SlackGPT leverages the wealth of institutional knowledge within Slack's messages, files, and shared content to enable users and developers to build AI-driven experiences. The goal is to bring AI natively into the user experience with features like AI-powered conversation summaries and writing assistance directly available in Slack. Additionally, developers can integrate AI into workflows, tapping into external apps and large language models. EinsteinGPT, Salesforce's generative AI, will also be integrated into Slack, allowing employees to ask questions directly related to Salesforce content, enhancing teams' understanding of customer data. While these capabilities are still in development, Slack aims to provide users with flexibility and choice in incorporating AI into their work. SlackGPT and EinsteinGPT integration are in the development phase, but developers can already build custom integrations with various large language models (LLMs). Workflow Builder with SlackGPT AI connectors will be available this summer, allowing customers to connect ChatGPT or Claude to workflows or build custom connectors for their own LLMs.",
-"reference_article": "Slack integrates AI into its platform, unveiling plans for AI-driven experiences",
-"reference_text": "Slack has evolved from a pure communications platform to one that enables companies to link directly to enterprise applications without having to resort to dreaded task switching. Today, at the Salesforce World Tour event in NYC, the company announced the next step in its platform’s evolution where it will be putting AI at the forefront of the user experience, making it easier to get information and build workflows...\n"
-  },
-  {
-  "question": "What are the two new products announced by Nova, the startup building generative AI tools to protect brand integrity?",
-  "answer": "Nova has announced two new products: BrandGuard and BrandGPT. BrandGuard ingests a company's brand guidelines and style guide, using a series of models to check content against those rules for compliance, quality, adherence to style, and alignment with campaign goals. BrandGPT serves as an interface for asking questions about a brand's content rules in a ChatGPT-style interaction. These tools are designed to help brands safeguard their brand integrity when incorporating generative AI into their creative workflows.",
-  "reference_article": "Nova introduces BrandGuard and BrandGPT to protect brand integrity in AI-generated content",
-  "reference_text": "Nova is an early-stage startup building a suite of generative AI tools designed to protect brand integrity, and today, the company is announcing two new products to help brands police AI-generated content: BrandGuard and BrandGPT."
-},
-  {
-  "question": "What is the startup Spawning AI doing to address the legal issues between artists and companies training AI on their artwork?",
-  "answer": "Spawning AI, co-founded by Jordan Meyer and Mathew Dryhurst, has created HaveIBeenTrained, a website that allows creators to opt out of the training dataset for one art-generating AI model called Stable Diffusion v3. Spawning raised $3 million in a seed round led by True Ventures to further develop IP standards for the AI era, establish more robust opt-out and opt-in standards, and build the consent layer for AI. The company aims to make it easier for AI model trainers to honor opt-out requests, offer more services to organizations protecting artists' work, and grow to address different domains in the AI economy.",
-  "reference_article": "Spawning raises $3M to help artists opt out of AI training data",
-  "reference_text": "In an effort to grant artists more control over how — and where — their art’s used, Jordan Meyer and Mathew Dryhurst co-founded the startup Spawning AI. Spawning created HaveIBeenTrained, a website that allows creators to opt out of the training dataset for one art-generating AI model, Stable Diffusion v3, due to be released in the coming months."
-},
-  {
-"question": "What is the U.K.'s Competition and Markets Authority (CMA) reviewing regarding AI?",
-"answer": "The CMA is conducting an initial review of 'AI foundational models,' which include large language models (LLMs) like OpenAI's ChatGPT and Microsoft's New Bing. The review aims to explore competition and consumer protection considerations in the development and use of AI foundational models. The CMA will examine how competitive markets for these models could evolve, explore opportunities and risks for competition and consumer protection, and produce guiding principles to support competition and protect consumers as AI foundation models develop. The review is in line with the U.K. government's instructions to regulators to analyze potential enforcements related to dangerous, unfair, and unaccountable applications of AI.",
-"reference_article": "U.K. competition watchdog launches review of AI foundational models",
-"reference_text": "The U.K.’s competition watchdog has announced an initial review of “AI foundational models”, such as the large language models (LLMs) which underpin OpenAI’s ChatGPT and Microsoft’s New Bing. Generative AI models which power AI art platforms such as OpenAI’s DALL-E or Midjourney will also likely fall in scope."
-},
-  {
-"question": "What is StarCoder and who developed it?",
-"answer": "StarCoder is a free alternative to code-generating AI systems, similar to GitHub's Copilot, developed by AI startup Hugging Face and ServiceNow Research, ServiceNow’s R&D division. It is part of Hugging Face's and ServiceNow’s BigCode project, which involves over 600 contributors. StarCoder is licensed for royalty-free use and was trained on over 80 programming languages using text from GitHub repositories. It integrates with Microsoft's Visual Studio Code code editor and claims to match or outperform the AI model from OpenAI used in the initial versions of Copilot.",
-"reference_article": "Hugging Face and ServiceNow Research release StarCoder, a free alternative to GitHub Copilot",
-"reference_text": "AI startup Hugging Face and ServiceNow Research, ServiceNow’s R&D division, have released StarCoder, a free alternative to code-generating AI systems along the lines of GitHub’s Copilot."
-},
-  {
-"question": "What are the new features coming to Bing, and how does Microsoft plan to enhance its search experience?",
-"answer": "Microsoft is introducing new features to enhance Bing's search experience, focusing on AI and visual elements. Bing Chat, powered by OpenAI's GPT-4 and DALL-E 2 models, will offer more image- and graphic-centric answers. The chatbot will become more visual and personalized, allowing users to export their chat histories and integrate content from third-party plugins. Bing Chat will answer questions within the context of images. Bing will also improve transparency by providing citations for fact-based responses. The Bing Image Creator tool will understand more languages, and Bing Chat will gain the ability to create charts and graphs. Microsoft aims to make Bing more multimodal, allowing users to upload images for related searches. New chat features include chat history storage, export and share functionalities, and the addition of plugins from partners like OpenTable and Wolfram Alpha. Edge, Microsoft's browser, will also receive updates, featuring rounded corners, improved design elements, and actions that translate Bing Chat prompts into automations within the browser.",
-"reference_article": "Microsoft doubles down on AI with new Bing features",
-"reference_text": "Microsoft is embarking on the next phase of Bing’s expansion. And — no surprise — it heavily revolves around AI."
-}
-]
+    "Question": "What are some of the new integrations and features that Slack announced to incorporate AI into its platform?",
+    "Answer": "Slack announced several new integrations and features to incorporate AI into its platform. These include SlackGPT, a generative AI built on top of the Slack platform that users and developers can tap into to build AI-driven experiences. Slack is also bringing AI natively into the user experience with features like AI-powered conversation summaries and writing assistance. Additionally, Slack will incorporate EinsteinGPT, Salesforce's generative AI, to provide insights from real-time customer data in Salesforce directly into Slack. These integrations are still in development, but developers can currently build custom integrations with a variety of large language models (LLMs).",
+    "Reference_article": "Not provided",
+    "Reference_text": "Not provided"
+  },
+  {
+    "Question": "What is Checks and how does it help mobile developers with privacy compliance?",
+    "Answer": "Checks is an AI-powered tool developed by Google to help mobile developers ensure compliance with privacy rules and regulations. It uses artificial intelligence and machine learning to scan apps and their code, identifying potential violations of privacy and data protection rules. Checks provides remediation suggestions on how to fix these issues, making it easier for developers to address privacy concerns. The tool is integrated with Google's language models and app understanding technologies to power its identification and suggestion capabilities. It offers a dashboard for monitoring and triaging compliance issues in areas such as compliance monitoring, data monitoring, and store disclosure support. While it currently focuses on Google Play data safety, it may expand to include Apple App Store data safety in the future.",
+    "Reference_article": "Not provided",
+    "Reference_text": "Not provided"
+  },
+  {
+    "Question": "What are the two new products that Nova has announced to help brands police AI-generated content?",
+    "Answer": "The two new products that Nova has announced to help brands police AI-generated content are BrandGuard and BrandGPT.",
+    "Reference_article": "Not provided",
+    "Reference_text": "Not provided"
+  },
+  {
+    "Question": "What is Pando's approach to solving supply chain challenges and how does it differentiate itself from other vendors?",
+    "Answer": "Pando aims to solve supply chain challenges by consolidating supply chain data from various sources and providing tools and apps for different tasks across freight procurement, trade and transport management, and more. It differentiates itself from other vendors like SAP and Oracle by offering no-code capabilities, allowing business users to customize the apps without the need for IT resources. Pando also utilizes algorithms and machine learning to make predictions and detect anomalies in the supply chain.",
+    "Reference_article": "Not provided",
+    "Reference_text": "Not provided"
+  },
+  {
+    "Question": "What are some controversies surrounding ChatGPT?",
+    "Answer": "ChatGPT has been involved in several controversies. Discord integrated OpenAI's technology into its bot named Clyde, which was tricked into providing instructions for making illegal drugs and incendiary mixtures. There have been cases of ChatGPT accusing individuals of false crimes, and it has been banned by some school systems and colleges for promoting plagiarism and misinformation. Additionally, there have been concerns about defamation and the use of AI-generated content for SEO farming.",
+    "Reference_article": "Not provided",
+    "Reference_text": "Not provided"
+  },
+  {
+    "Question": "What are the concerns of writers regarding the use of AI in the entertainment industry?",
+    "Answer": "Writers are concerned that the use of AI in the entertainment industry could undermine their working conditions and devalue their labor. They argue that AI-generated content should not be considered as writers' work and that their job involves more than just scriptwriting. They also worry that studios may use AI as a way to demand more from writers in a shorter period of time without adequately compensating them. Additionally, the legal status of AI-generated content remains unclear, which further complicates the issue.",
+    "Reference_article": "Not provided",
+    "Reference_text": "Not provided"
+  },
+  {
+    "Question": "What new features is Microsoft adding to Bing?",
+    "Answer": "Not provided",
+    "Reference_article": "Not provided",
+    "Reference_text": "Not provided"
+  },
+  {
+    "Question": "What is the U.K.'s competition watchdog reviewing in relation to AI?",
+    "Answer": "Not provided",
+    "Reference_article": "Not provided",
+    "Reference_text": "Not provided"
+  },
+  {
+    "Question": "What is Spawning AI's solution to give artists more control over how their art is used in generative AI models?",
+    "Answer": "Not provided",
+    "Reference_article": "Not provided",
+    "Reference_text": "Not provided"
+  },
+  {
+    "Question": "What is StarCoder and how does it compare to other code-generating AI systems?",
+    "Answer": "Not provided",
+    "Reference_article": "Not provided",
+    "Reference_text": "Not provided"
+  },
+  {
+    "Question": "What is the focus of Okera's data governance platform and how does it use AI technology?",
+    "Answer": "Okera's data governance platform focuses on AI and uses AI-powered systems to automatically discover and classify personally identifiable information, tag it, and apply rules to it. It utilizes a no-code interface and emphasizes metadata.",
+    "Reference_article": "Not provided",
+    "Reference_text": "Not provided"
+  }
+]

main.py

@@ -1,6 +1,7 @@
 import os
 import gradio as gr
 import autogen
+import json
 from src.mapper.e5map import E5Mapper
 from src.mapper.scimap import scimap
 from src.mapper.parser import MapperParser
@@ -12,7 +13,7 @@ this is a highly adaptive technical operator that will listen to your query and
 """
 
 def update_config_file(api_key):
-    config_path = "./config/OAI_CONFIG_LIST.json"
+    config_path = "./src/config/OAI_CONFIG_LIST.json"
     with open(config_path, "r") as file:
         config = json.load(file)
 
@@ -67,7 +68,7 @@ def process_query(oai_key, query, max_auto_reply):
     update_config_file(oai_key)
     os.environ['OAI_KEY'] = oai_key
     llm_config = autogen.config_list_from_json(
-        env_or_file="./config/OAI_CONFIG_LIST.json",
+        env_or_file="./src/config/OAI_CONFIG_LIST.json",
         filter_dict={"model": {"gpt-4", "gpt-3.5-turbo-16k", "gpt-4-1106-preview"}}
     )
 
@@ -118,10 +119,10 @@ def main():
             txt_pat = gr.Textbox(label="Clarifai PAT", type="password", placeholder="Enter Clarifai PAT here")
             txt_query = gr.Textbox(label="Describe your problem in detail:")
             txt_max_auto_reply = gr.Number(label="Max Auto Replies", value=50)
-            audio_input = gr.Audio(label="Or speak your problem here:", type="numpy")
-            image_input = gr.Image(label="Or upload an image related to your problem:", type="numpy")
+            audio_input = gr.Audio(label="Or speak your problem here:", type="numpy",)
+            image_input = gr.Image(label="Or upload an image related to your problem:", type="numpy", )
         btn_submit = gr.Button("Submit")
-        output = gr.Textbox(label="Output")
+        output = gr.Textbox(label="Output",)
 
         def process_and_submit(oai_key, pat, query, max_auto_reply, audio, image):
             os.environ['CLARIFAI_PAT'] = pat

requirements.txt

@@ -1,7 +1,7 @@
 streamlit
 gradio
 datasets
-pyautogen
+autogen
 chromadb
 semantic-kernel
 llama-index
@@ -9,5 +9,6 @@ llama-hub
 langchain
 huggingface_hub
 openai
-pypdf
-ipython
+Ipython
+pyautogen
+pypdf

src/agentics/agents.py

@@ -20,13 +20,15 @@ llm_config = {
          "temperature": 0,
      }
 
+def termination_msg(self, x):
+        return isinstance(x, dict) and "TERMINATE" == str(x.get("content", ""))[-9:].upper()
+
 class AgentsFactory:
     def __init__(self, llm_config, db_path):
         self.llm_config = llm_config
         self.db_path = db_path
 
-    def termination_msg(self, x):
-        return isinstance(x, dict) and "TERMINATE" == str(x.get("content", ""))[-9:].upper()
+    
 
     def tonic(self) :
         return autogen.UserProxyAgent(

src/config/OAI_CONFIG_LIST.json

@@ -1,25 +1,25 @@
 [
     {
         "model": "gpt-3.5-turbo-preview",
-        "api_key": "your OpenAI Key goes here",
+        "api_key": "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",
         "base_url": "https://api.openai.com/v1",
         "api_version": "2023-06-01-preview"
     },
     {
         "model": "gpt-4-preview",
-        "api_key": "your OpenAI Key goes here",
+        "api_key": "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",
         "base_url": "https://api.openai.com/v1",
         "api_version": "2023-06-01-preview"
     },
     {
         "model": "gpt-4-vision-preview",
-        "api_key": "your OpenAI Key goes here",
+        "api_key": "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",
         "base_url": "https://api.openai.com/v1",
         "api_version": "2023-06-01-preview"
     },
     {
         "model": "dall-e-3",
-        "api_key": "your OpenAI Key goes here",
+        "api_key": "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",
         "base_url": "https://api.openai.com/v1",
         "api_version": "2023-06-01-preview"
     }

src/datatonic/dataloader.py

@@ -89,7 +89,10 @@ class DataLoader:
         if dataset_name in self.datasets:
             return self.datasets[dataset_name]()
         else:
-            raise ValueError(f"Dataset {dataset_name} not supported.")
+            # Log or return an error message and default to "gpl-arguana"
+            error_message = f"Dataset '{dataset_name}' not supported. Defaulting to 'gpl-arguana'."
+            print(error_message)  # or handle this message as needed
+            return self.load_gpl_arguana()  # Default to the 'gpl-arguana' dataset
 
     def save_to_json(self, data, file_name):
         with open(file_name, 'w') as f:

src/documentation/PROJECT.md

@@ -1,13 +1,39 @@
-# 🌟 Sci-Tonic: Your Ultimate Technical Research Assistant 🚀
+# Introducing 🧪👩🏻‍🔬Sci-Tonic - Your Ultimate Technical Research Assistant 🚀
 
-Welcome to **Sci-Tonic** 🎉, the groundbreaking technical research assistant designed for professionals, researchers, and enthusiasts alike! If you're looking to dive deep into the world of data, ranging from financial figures 📈 to scientific articles 🧬, and transform them into insightful, long-form multimedia outputs 📊📚, you've just found your new best friend! 🤖👩‍🔬👨‍💼
+### Welcome to the Future of Technical Research: Sci-Tonic 🌐
 
-## Features 🌈
+In an era where data is king 👑, the ability to efficiently gather, analyze, and present information is crucial for success across various fields. Today, we are thrilled to introduce Sci-Tonic 🤖, a state-of-the-art technical research assistant that revolutionizes how professionals, researchers, and enthusiasts interact with data. Whether it's financial figures 💹, scientific articles 🧬, or complex texts 📚, Sci-Tonic is your go-to solution for turning data into insights.
 
-Sci-Tonic is packed with amazing features:
+## Features of Sci-Tonic 🌈
 
-- **Data Retrieval**: Effortlessly fetch data from a vast array of sources. Financial reports, scientific papers, complex texts - you name it, Sci-Tonic retrieves it! 🌍🔍
-- **Advanced Analysis**: Using cutting-edge AI, Sci-Tonic analyzes and interprets your data, providing you with deep insights. 🧠💡
-- **Multimedia Output**: Get your results the way you want them. Text, infographics, video summaries - Sci-Tonic does it all! 📝🎥📊
-- **User-Friendly Interface**: Whether you're a tech guru or a newbie, our intuitive interface makes your research journey smooth and enjoyable. 🖥️😊
-- **Collaboration Tools**: Teamwork makes the dream work! Collaborate seamlessly with colleagues or classmates. 👥🤝
+### 1. Data Retrieval: A Gateway to Information 🚪📊
+- **Broad Spectrum Access**: From financial reports to scientific papers, Sci-Tonic accesses a wide array of data sources.
+- **Efficiency and Precision**: Quickly fetches relevant data, saving you time and effort ⏰💼.
+
+### 2. Advanced Analysis: Deep Insights from Cutting-Edge AI 🧠💡
+- **Intelligent Interpretation**: Utilizes advanced AI algorithms to analyze and interpret complex data sets.
+- **Customizable Analysis**: Tailored to meet specific research needs, providing targeted insights 🔍.
+
+### 3. Multimedia Output: Diverse and Dynamic Presentation 📝🎥📊
+- **Versatile Formats**: Outputs range from text and infographics to video summaries.
+- **Engaging and Informative**: Enhances understanding and retention of information 🌟.
+
+### 4. User-Friendly Interface: Accessible to All 👩‍💻👨‍💻
+- **Intuitive Design**: Easy to navigate for both tech experts and novices.
+- **Seamless Experience**: Makes research not just productive but also enjoyable 🎉.
+
+### 5. Adaptive Technical Operator 🤖
+- **High Performance**: Capable of handling complex analyses with ease.
+- **On-the-Fly Adaptability**: Quickly adjusts to new data and user requests 🌪️.
+
+## Applications of Sci-Tonic 🛠️
+- **Academic Research**: Streamlines the process of gathering and analyzing scientific data 🎓🔬.
+- **Financial Analysis**: Provides comprehensive insights into market trends and financial reports 💹.
+- **Business Intelligence**: Assists in making data-driven decisions for business strategies 📈.
+- **Personal Use**: Aids enthusiasts in exploring data in their fields of interest 🌍.
+
+## Choose Sci-Tonic? 🤔
+- **Efficiency**: Saves time and effort in data collection and analysis ⏳.
+- **Accuracy**: Provides reliable and precise insights 🔎.
+- **Customization**: Adapts to specific user needs and preferences 🛠️.
+- **Innovation**: Employs the latest AI technology for data analysis 🚀.