JovanVeljanoski/jupyter-voicepilot
A JupyterLab extension for generating code and interacting with JupyterLab via voice commands. This extension can also be used for some basic nagivation around in JupyterLab Notebook. It is built around OpenAI's Whisper-1 and GPT-3 APIs. You will need to have an OpenAI API key to use this extension.
Click the Voice Pilot button in the JupyterLab to start recording your instruction. When done, click the button again to stop the recording. The extension will then process your instruction and execute the appropriate action.
If a cell is of type code, the extension will generate code based on the input you provided. The generated code will be inserted in the cell. An exception to this is when you provide a set phrase which is mapped to a specific Notebook navigation action. See below for more details.
If a cell is of type markdown, the extension will insert the text you provided in the cell. An exception to this is when you provide a set phrase which is mapped to a specific Notebook navigation action. See below for more details.
