diff --git a/pages/20240803-building-on-bedrock/index.md b/pages/20240803-building-on-bedrock/index.md new file mode 100644 index 0000000..c54b2dd --- /dev/null +++ b/pages/20240803-building-on-bedrock/index.md @@ -0,0 +1,20 @@ +--- +date: 2024-08-03 +title: Building on Bedrock +excerpt: We started using Amazon Bedrock at work about a year ago to thoughtfully integrate large language models (LLMs) into some of our internal tools and processes. I want to write a series of posts capturing what I've learned from the effort. +--- +We started using Amazon Bedrock at work about a year ago to thoughtfully integrate [large language models (LLMs)](https://en.wikipedia.org/wiki/Large_language_model) into some of our internal tools and processes. I want to write a series of posts capturing what I've learned from the effort and to riff on "what-if" alternatives in some places. I expect the result to wander through topics like: + +- setting up for happy local development +- abstracting LLM use with the [Bedrock Converse API](https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference.html) +- letting a model call external functions with [Bedrock Tool Use](https://docs.aws.amazon.com/bedrock/latest/userguide/tool-use.html) +- populating and querying [Bedrock Knowledge Bases](https://aws.amazon.com/bedrock/knowledge-bases/) +- structuring larger [Streamlit](https://streamlit.io/) applications for extension and maintenance +- deploying [Slack Bolt](https://slack.dev/bolt-python/) apps to a serverless platform +- single-table design with [pynamodb](https://pynamodb.readthedocs.io/en/stable/) / [DynamoDB](https://aws.amazon.com/dynamodb/) +- provisioning infrastructure with [AWS CDK](https://aws.amazon.com/cdk/) as a Terraform veteran +- observing how the system is working with [AWS X-Ray](https://aws.amazon.com/xray/) as a Datadog adept + +You won't go from zero-to-chatbot in 10 minutes reading what I write here. [There are plenty](https://www.google.com/search?q=chat+bot+with+aws+bedrock) of better resources for that. Rather, I hope this series highlights design considerations and ancillary work needed to use LLMs and realize their value. + +I have no timeline for publishing, only this entry as a starting point. \ No newline at end of file