diff options
Diffstat (limited to 'openbb_terminal')
44 files changed, 0 insertions, 14899 deletions
diff --git a/openbb_terminal/CONTRIBUTING.md b/openbb_terminal/CONTRIBUTING.md deleted file mode 100644 index 49314e4a8e4..00000000000 --- a/openbb_terminal/CONTRIBUTING.md +++ /dev/null @@ -1,1724 +0,0 @@ -# CONTRIBUTING - -First off, thanks for taking the time to contribute (or at least read the Contributing Guidelines)! 🚀 - -The following is a set of guidelines for contributing to OpenBB Terminal. These are mostly guidelines, not rules. -Use your best judgment, and feel free to propose changes to this document in a pull request. - -- [CONTRIBUTING](#contributing) -- [BASIC](#basic) - - [Adding a new command](#adding-a-new-command) - - [Select Feature](#select-feature) - - [Model](#model) - - [Data sources](#data-sources) - - [View](#view) - - [Controller](#controller) - - [Add SDK endpoint (V3)](#add-sdk-endpoint-v3) - - [Add OpenBB Platform endpoint (V4)](#add-openbb-platform-endpoint-v4) - - [Add Unit Tests](#add-unit-tests) - - [Open a Pull Request](#open-a-pull-request) - - [Review Process](#review-process) - - [Understand Code Structure](#understand-code-structure) - - [Backend](#backend) - - [Frontend](#frontend) - - [Follow Coding Guidelines](#follow-coding-guidelines) - - [General Code Requirements](#general-code-requirements) - - [File Specific Requirements](#file-specific-requirements) - - [Coding Style](#coding-style) - - [OpenBB Style Guide](#openbb-style-guide) - - [Flags](#flags) - - [Output format](#output-format) - - [Time-related](#time-related) - - [Data selection and manipulation](#data-selection-and-manipulation) - - [Financial instrument characteristics](#financial-instrument-characteristics) - - [Naming Convention](#naming-convention) - - [Docstrings](#docstrings) - - [Linters](#linters) - - [Command names](#command-names) - - [UI and UX](#ui-and-ux) - - [External API Keys](#external-api-keys) - - [Creating API key](#creating-api-key) - - [Setting and checking API key](#setting-and-checking-api-key) -- [ADVANCED](#advanced) - - [Important functions and classes](#important-functions-and-classes) - - [Base controller class](#base-controller-class) - - [Default Data Sources](#default-data-sources) - - [Export Data](#export-data) - - [Queue and pipeline](#queue-and-pipeline) - - [Auto Completer](#auto-completer) - - [Logging](#logging) - - [Internationalization](#internationalization) - - [Settings](#settings) - - [Write Code and Commit](#write-code-and-commit) - - [Pre Commit Hooks](#pre-commit-hooks) - - [Coding](#coding) - - [Git Process](#git-process) - - [Branch Naming Conventions](#branch-naming-conventions) - - [Installers](#installers) - -# BASIC - -## Adding a new command - -Before implementing a new command we highly recommend that you go through [Understand Code Structure](#understand-code-structure) and [Follow Coding Guidelines](#follow-coding-guidelines). This will allow you to get your PR merged faster and maintain consistency in our code base. - -In the next sections we describe the process to add a new command. -We will be adding a function to get price targets from the Financial Modeling Prep API. Note that there already exists a function to get price targets from the Business Insider website, `stocks/fa/pt`, so we will be adding a new function to get price targets from the Financial Modeling Prep API, and go through adding sources. - -### Select Feature - -- Pick a feature you want to implement or a bug you want to fix from [our issues](https://github.com/OpenBB-finance/OpenBBTerminal/issues). -- Feel free to discuss what you'll be working on either directly on [the issue](https://github.com/OpenBB-finance/OpenBBTerminal/issues) or on [our Discord](https://openbb.co/discord). - - This ensures someone from the team can help you and there isn't duplicated work. - -Before writing any code, it is good to understand what the data will look like. In this case, we will be getting the price targets from the Financial Modeling Prep API, and the data will look like this: - -```json -[ - { - "symbol": "AAPL", - "publishedDate": "2023-02-03T16:19:00.000Z", - "newsURL": "https://pulse2.com/apple-stock-receives-a-195-price-target-aapl/", - "newsTitle": "Apple Stock Receives A $195 Price Target (AAPL)", - "analystName": "Cowen Cowen", - "priceTarget": 195, - "adjPriceTarget": 195, - "priceWhenPosted": 154.5, - "newsPublisher": "Pulse 2.0", - "newsBaseURL": "pulse2.com", - "analystCompany": "Cowen & Co." - } -``` - -### Model - -1. Create a file with the source of data as the name followed by `_model` if it doesn't exist. In this case, the file `openbb_terminal/stocks/fundamental_analysis/fmp_model.py` already exists, so we will add the function to that file. -2. Add the documentation header -3. Do the necessary imports to get the data -4. Define a function starting with `get_` -5. In this function: - 1. Use type hinting - 2. Write a descriptive description where at the end the source is specified. - 3. Utilize an official API, get and return the data. - -```python -""" Financial Modeling Prep Model """ -__docformat__ = "numpy" - -import logging - -import pandas as pd - -from src.current_user import get_current_user -from openbb_terminal.decorators import check_api_key, log_start_end -from openbb_terminal.helpers import request - -logger = logging.getLogger(__name__) - - -@check_api_key(["API_KEY_FINANCIALMODELINGPREP"]) -def get_price_targets(cls, symbol: str) -> pd.DataFrame: - """Get price targets for a company [Source: Financial Modeling Prep] - - Parameters - ---------- - symbol : str - Symbol to get data for - - Returns - ------- - pd.DataFrame - DataFrame of price targets - """ - current_user = get_current_user() - - url = f"https://financialmodelingprep.com/api/v4/price-target?symbol={symbol}&apikey={current_user.credentials.API_KEY_FINANCIALMODELINGPREP}" - response = request(url) - - # Check if the response is valid - if response.status_code != 200 or "Error Message" in response.json(): - message = f"Error, Status Code: {response.status_code}." - message = ( - message - if "Error Message" not in response.json() - else message + "\n" + response.json()["Error Message"] + ".\n" - ) - console.print(message) - return pd.DataFrame() - - return pd.DataFrame(response.json()) -``` - -In this function: - -- We import the current user object and, consequently, preferences using the `get_current_user` function. API keys are stored in `current_user.credentials` -- We use the `@log_start_end` decorator to add the function to our logs for debugging purposes. -- We add the `@check_api_key` decorator to confirm the API key is valid. -- We have type hinting and a docstring describing the function. -- We use the openbb_terminal helper function `request`, which is an abstracted version of the requests library, which allows us to add user agents, timeouts, caches, etc. to any HTTP request in the terminal. -- We check for different error messages. This will depend on the API provider and usually requires some trial and error. With the FMP API, if there is an invalid symbol, we get a response code of 200, but the json response has an error message field. Same with an invalid API key. -- When an error is caught, we still return an empty dataframe. -- We return the json response as a pandas dataframe. Most functions in the terminal should return a dataframe, but if not, make sure that the return type is specified. - -Note: - -1. If the function is applicable to many asset classes, it is possible that this file needs to be created under `common/` directory rather than `stocks/`, which means the function should be written in a generic way, i.e. not mentioning stocks or a specific context. -2. If the model requires an API key, make sure to handle the error and output relevant message. -3. If the data provider is not yet supported, you'll most likely need to do some extra steps in order to add it to the `keys` menu. See [this section](#external-api-keys) for more details. - -Some of the most common error messages are: - -- Error in the request (HTTP error) -- Invalid API Keys -- API Keys not authorized for Premium feature -- Empty return payload -- Invalid arguments (Optional) - -In the example below, you can see that we explicitly handle some of them. -It's not always possible to distinguish error types using `status_code`. So depending on the API provider, you can use either error messages or exceptions. - -```python - -@check_api_key(["API_NEWS_TOKEN"]) -def get_news( - query: str, - limit: int = 10, - start_date: Optional[str] = None, - show_newest: bool = True, - sources: str = "", -) -> pd.DataFrame: - - ... - - link += f"&apiKey={get_current_user().credentials.API_NEWS_TOKEN}" - response = request(link) - articles = {} - - if response.status_code == 200: - response_json = response.json() - articles = (response_json["articles"] if show_newest else response_json["articles"][::-1]) - - elif response.status_code == 426: - console.print(f"Error in request: {response.json()['message']}", "\n") - elif response.status_code == 401: - console.print("[red]Invalid API Key[/red]\n") - elif response.status_code == 429: - console.print("[red]Exceeded number of calls per minute[/red]\n") - else: - console.print(f"Error in request: {response.json()['message']}", "\n") - - ... -``` - -> Click [here](openbb_terminal/common/newsapi_model.py) to see the example in detail. - -### Data sources - -Now that we have added the model function getting, we need to specify that this is an available data source. To do so, we edit the `openbb_terminal/miscellaneous/sources/openbb_default.json` file. This file, described below, uses a dictionary structure to identify available sources. Since we are adding FMP to `stocks/fa/pt`, we find that entry and append it: - -```json - "fa": { - "pt": ["BusinessInsider", "FinancialModelingPrep"], -``` - -If you are adding a new function with a new data source, make a new value in the file. If the data source requires an -API key, please refer to the guide below for adding them. Instructions for obtaining the new api key -should be included in the file `OpenBBTerminal/website/content/terminal/usage/data/api-keys.md`. - -### View - -1. Create a file with the source of data as the name followed by `_view` if it doesn't exist, e.g. `fmp_view` -2. Add the documentation header -3. Do the necessary imports to display the data. One of these is the `_model` associated with this `_view`. I.e. from same data source. -4. Define a function starting with `display_` -5. In this function: - - Use typing hints - - Write a descriptive description where at the end the source is specified - - Get the data from the `_model` and parse it to be output in a more meaningful way. - - Do not degrade the main data dataframe coming from model if there's an export flag. This is so that the export can have all the data rather than the short amount of information we may show to the user. Thus, in order to do so `df_data = df.copy()` can be useful as if you change `df_data`, `df` remains intact. -6. If the source requires an API Key or some sort of tokens, add `check_api_key` decorator on that specific view. This will throw a warning if users forget to set their API Keys -7. Finally, call `export_data` where the variables are export variable, current filename, command name, and dataframe. - -```python - -@check_api_key(["API_KEY_FINANCIALMODELINGPREP"]) -def display_price_targets( - symbol: str, limit: int = 10, export: str = "", sheet_name: Optional[str] = None -): - """Display price targets for a given ticker. [Source: Financial Modeling Prep] - - Parameters - ---------- - symbol : str - Symbol - limit: int - Number of last days ratings to display - export: str - Export dataframe data to csv,json,xlsx file - sheet_name: str - Optionally specify the name of the sheet the data is exported to. - """ - columns_to_show = [ - "publishedDate", - "analystCompany", - "adjPriceTarget", - "priceWhenPosted", - ] - price_targets = fmp_model.get_price_targets(symbol) - if price_targets.empty: - console.print(f"[red]No price targets found for {symbol}[/red]\n") - return - price_targets["publishedDate"] = price_targets["publishedDate"].apply( - lambda x: datetime.strptime(x, "%Y-%m-%dT%H:%M:%S.%fZ").strftime("%Y-%m-%d %H:%M") - ) - export_data( - export, - os.path.dirname(os.path.abspath(__file__)), - "pt", - price_targets, - sheet_name, - ) - - print_rich_table( - price_targets[columns_to_show].head(limit), - headers=["Date", "Company", "Target", "Posted Price"], - show_index=False, - title=f"{symbol.upper()} Price Targets", - ) -``` - -In this function: - -- We use the same log and API decorators as in the model. -- We define the columns we want to show to the user. -- We get the data from the fmp_model function -- We check if there is data. If something went wrong, we don't want to show it, so we print a message and return. Note that because we have error messages in both the model and view, there will be two print outs. If you wish to just show one, it is better to handle in the model. -- We do some parsing of the data to make it more readable. In this case, the output from FMP is not very clear at quick glance, we we put it into something more readable. -- We export the data. In this function, I decided to export after doing the manipulation. If we do any removing of columns, we should copy the dataframe before exporting. -- We print the data in table form using our `print_rich_table`. This provides a nice console print using the rich library. Note that here I show the top `limit` rows of the dataframe. Care should be taken to make sure that things are sorted. If a sort is required, there is a `reverse` argument that can be added to sort in reverse order. - -### Controller - -Now that we have the model and views, it is time to add to the controller. - -1. Import the associated `_view` function to the controller. -2. Add command name to variable `CHOICES_COMMANDS` from `FundamentalAnalysisController` class. -3. Add command and source to `print_help()`. - - ```python - def print_help(self): - """Print help.""" - mt = MenuText("stocks/fa/") - mt.add_cmd("load") - mt.add_raw("\n") - mt.add_param("_ticker", self.ticker.upper()) - mt.add_raw("\n") - mt.add_info("_company_overview") - mt.add_cmd("mktcap") - mt.add_cmd("overview") - mt.add_cmd("divs", not self.suffix) - - ... - - mt.add_cmd("pt") - mt.add_cmd("dcf") - mt.add_cmd("dcfc") - console.print(text=mt.menu_text, menu="Stocks - Fundamental Analysis") - ``` - -4. If there is a condition to display or not the command, this is something that can be leveraged through the `add_cmd` method, e.g. `mt.add_cmd("divs", not self.suffix)`. - -5. Add command description to file `i18n/en.yml`. Use the path and command name as key, e.g. `stocks/fa/pt` and the value as description. Please fill in other languages if this is something that you know. - -6. Add a method to `FundamentalAnalysisController` class with name: `call_` followed by command name. - - This method must start defining a parser with arguments `add_help=False` and - `formatter_class=argparse.ArgumentDefaultsHelpFormatter`. In addition `prog` must have the same name as the command, and `description` should be self-explanatory ending with a mention of the data source. - - Add parser arguments after defining parser. One important argument to add is the export capability. All commands should be able to export data. - - If there is a single or even a main argument, a block of code must be used to insert a fake argument on the list of args provided by the user. This makes the terminal usage being faster. - - ```python - if other_args and "-" not in other_args[0][0]: - other_args.insert(0, "-l") - ``` - - - Parse known args from list of arguments and values provided by the user. - - Call the function contained in a `_view.py` file with the arguments parsed by argparse. - -Note that the function self.parse_known_args_and_warn() has some additional options we can add. If the function is showing a chart, but we want the option to show raw data, we can add the `raw=True` keyword and the resulting namespace will have the `raw` attribute. -Same with limit, we can pass limit=10 to add the `-l` flag with default=10. Here we also specify the export, and whether it is data only, plots only or anything else. This function also adds the `source` attribute to the namespace. In our example, this is important because we added an additional source. - -Our new function will be: - -```python - - def call_pt(self, other_args: List[str]): - """Process pt command""" - parser = argparse.ArgumentParser( - add_help=False, - prog="pt", - description="""Prints price target from analysts. [Source: Business Insider and Financial Modeling Prep]""", - ) - parser.add_argument( - "-t", - "--ticker", - dest="ticker", - help="Ticker to analyze", - type=str, - default=None, - ) - if other_args and "-" not in other_args[0][0]: - other_args.insert(0, "-t") - ns_parser = self.parse_known_args_and_warn( - parser, other_args, EXPORT_BOTH_RAW_DATA_AND_FIGURES, raw=True, limit=10 - ) - if ns_parser: - if ns_parser.ticker: - self.ticker = ns_parser.ticker - self.custom_load_wrapper([self.ticker]) - - if ns_parser.source == "BusinessInsider": - business_insider_view.display_price_target_from_analysts( - symbol=self.ticker, - data=self.stock, - start_date=self.start, - limit=ns_parser.limit, - raw=ns_parser.raw, - export=ns_parser.export, - sheet_name=" ".join(ns_parser.sheet_name) - if ns_parser.sheet_name - else None, - ) - elif ns_parser.source == "FinancialModelingPrep": - fmp_view.display_price_targets( - symbol=self.ticker, - limit=ns_parser.limit, - export=ns_parser.export, - sheet_name=" ".join(ns_parser.sheet_name) - if ns_parser.sheet_name |