Skip to content

Commit 7e39246

Browse files
authored
docs: upgrade_0.8.0 (#3257)
1 parent 15857de commit 7e39246

34 files changed

Lines changed: 149 additions & 115 deletions

CHANGELOG.md

Lines changed: 32 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,36 @@
11
# Changelog
22

3+
## [0.8.0] - 2023-05-11
4+
5+
### Features
6+
- Add a new synchronization tool to automatically synchronize data from online storage to offline storage (#3256 @vagetablechicken)
7+
- Support the new built-in functions `var_samp`, `var_pop`, `entropy`, `earth_distance`, `nth_value_where` and `add_months` (#3046 #3193 @aceforeverd)
8+
- Support batch read for openmldb-spark-connector (#3070 @tobegit3hub)
9+
- [Alpha] Support Kubernetes as a TaskManager backend for the offline engine (#3147 #3157 #3185 @tobegit3hub)
10+
- Support LAST JOIN over WHERE clause (#3134 @aceforeverd)
11+
- Support LAST JOIN in WINDOW UNION clause (#3205 @aceforeverd)
12+
- Supports a decimal place as the second parameter in the function `round` (#3221 @aceforeverd)
13+
- Support Amazon S3 as an offline data source (#3229 #3261 @tobegit3hub)
14+
- Enhance the diagnostic tool (#3224 #3208 @zhangziheng01233)
15+
- Add the new option `SKIP_INDEX_CHECK` to skip index checking when deploying SQLs (#3241 @dl239)
16+
- Support symbolic paths for offline table (#3235 @tobegit3hub)
17+
- Improve the documents (#3104 #2993 @selenachenjingxin, #3113 #3118 #3239 @tobegit3hub, #3150 #3184 #3237 #3255 @aceforeverd, #3160 #3195 #3197 #3223 @lumianph, #3192 #3215 @haseeb-xd, #3201 #3220 #3232 #3236 #3254 @vagetablechicken, #3213 @alexab612, #3189 #3199 @TanZiYen)
18+
- Other minor features (#3115 #3143 #3182 @tobegit3hub, #2818 #3123 @aceforeverd, #3128 #3127 @dl239)
19+
20+
### Bug Fixes
21+
- There is curator conflict problem when executing offline SQLs under certain circumstances. (#3090 @tobegit3hub)
22+
- `CREATE TABLE ... LIKE HIVE ...` statement execution fails if there is no database in a table name. (#3063 @tobegit3hub)
23+
- The CLI shows `success` even though `CREATE TABLE ... LIKE ...` execution fails. (#3080 @tobegit3hub)
24+
- `SELECT ... INTO ...` statement execution fails in the offline mode if there is no source table. (#3116 @tobegit3hub)
25+
- Compilation fails when `SELECT * ` over two LAST JOIN. (#3117 @aceforeverd)
26+
- The syncing job thread will enter an infinite loop if querying `JOB_INFO` fails. (#3169 @vagetablechicken)
27+
- SQLs deployment fails if there are more than one conditions on a JOIN statement. (#3196 @vagetablechicken)
28+
- Registered tables cannot be fetched when enabling SparkSQL for the offline engine (#3057 @tobegit3hub)
29+
- Other minor bug fixes (#3097 #3095 @dl239, #3109 #3141 #3162 #3234 @aceforeverd, #3096 #3112 @tobegit3hub, #3231 #3251 @vagetablechicken)
30+
31+
### Code Refactoring
32+
#3188 @tobegit3hub
33+
334
## [0.7.3] - 2023-03-22
435

536
### Features
@@ -546,6 +577,7 @@ Removed
546577
- openmldb-0.2.0-linux.tar.gz targets on x86_64
547578
- aarch64 artifacts consider experimental
548579

580+
[0.8.0]: https://github.com/4paradigm/OpenMLDB/compare/v0.7.3...v0.8.0
549581
[0.7.3]: https://github.com/4paradigm/OpenMLDB/compare/v0.7.2...v0.7.3
550582
[0.7.2]: https://github.com/4paradigm/OpenMLDB/compare/v0.7.1...v0.7.2
551583
[0.7.1]: https://github.com/4paradigm/OpenMLDB/compare/v0.7.0...v0.7.1

demo/java_quickstart/demo/pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@
2929
<dependency>
3030
<groupId>com.4paradigm.openmldb</groupId>
3131
<artifactId>openmldb-jdbc</artifactId>
32-
<version>0.7.3</version>
32+
<version>0.8.0</version>
3333
</dependency>
3434
<dependency>
3535
<groupId>org.testng</groupId>

demo/jd-recommendation/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ For full instructions, please refer to [website page](http://openmldb.ai/docs/zh
1111
## OpenMLDB Feature Extraction
1212

1313
```
14-
docker run -dit --name=openmldb --network=host -v $demodir:/work/oneflow_demo 4pdosc/openmldb:0.7.3 bash
14+
docker run -dit --name=openmldb --network=host -v $demodir:/work/oneflow_demo 4pdosc/openmldb:0.8.0 bash
1515
docker exec -it openmldb bash
1616
```
1717

demo/predict-taxi-trip-duration/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,7 @@ w2 as (PARTITION BY passenger_count ORDER BY pickup_datetime ROWS_RANGE BETWEEN
2828
2929
**Start docker**
3030
```
31-
docker run -it 4pdosc/openmldb:0.7.3 bash
31+
docker run -it 4pdosc/openmldb:0.8.0 bash
3232
```
3333
**Initialize environment**
3434
```bash
@@ -138,7 +138,7 @@ python3 predict.py
138138
**Start docker**
139139
140140
```bash
141-
docker run -it 4pdosc/openmldb:0.7.3 bash
141+
docker run -it 4pdosc/openmldb:0.8.0 bash
142142
```
143143
**Initialize environment**
144144

demo/talkingdata-adtracking-fraud-detection/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ We recommend you to use docker to run the demo. OpenMLDB and dependencies have b
1515
**Start docker**
1616

1717
```
18-
docker run -it 4pdosc/openmldb:0.7.3 bash
18+
docker run -it 4pdosc/openmldb:0.8.0 bash
1919
```
2020

2121
#### Run locally

docs/en/deploy/compile.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -7,25 +7,25 @@
77
This section describes the steps to compile and use OpenMLDB inside its official docker image [hybridsql](https://hub.docker.com/r/4pdosc/hybridsql).
88
The docker image has packed required tools and dependencies, so there is no need to set them up separately. To compile without the official docker image, refer to the section [Detailed Instructions for Build](#detailed-instructions-for-build) below.
99

10-
Keep in mind that you should always use the same version of both compile image and [OpenMLDB version](https://github.com/4paradigm/OpenMLDB/releases). This section demonstrates compiling for [OpenMLDB v0.7.3](https://github.com/4paradigm/OpenMLDB/releases/tag/v0.7.3) under `hybridsql:0.7.3` ,If you prefer to compile on the latest code in `main` branch, pull `hybridsql:latest` image instead.
10+
Keep in mind that you should always use the same version of both compile image and [OpenMLDB version](https://github.com/4paradigm/OpenMLDB/releases). This section demonstrates compiling for [OpenMLDB v0.8.0](https://github.com/4paradigm/OpenMLDB/releases/tag/v0.8.0) under `hybridsql:0.8.0` ,If you prefer to compile on the latest code in `main` branch, pull `hybridsql:latest` image instead.
1111

1212
1. Pull the docker image
1313

1414
```bash
15-
docker pull 4pdosc/hybridsql:0.7
15+
docker pull 4pdosc/hybridsql:0.8
1616
```
1717

1818
2. Create a docker container with the hybridsql docker image
1919

2020
```bash
21-
docker run -it 4pdosc/hybridsql:0.7 bash
21+
docker run -it 4pdosc/hybridsql:0.8 bash
2222
```
2323

24-
3. Download the OpenMLDB source code inside the docker container, and setting the branch into v0.7.3
24+
3. Download the OpenMLDB source code inside the docker container, and setting the branch into v0.8.0
2525

2626
```bash
2727
cd ~
28-
git clone -b v0.7.3 https://github.com/4paradigm/OpenMLDB.git
28+
git clone -b v0.8.0 https://github.com/4paradigm/OpenMLDB.git
2929
```
3030

3131
4. Compile OpenMLDB
@@ -151,7 +151,7 @@ The built jar packages are in the `target` path of each submodule. If you want t
151151
1. Downloading the pre-built OpenMLDB Spark distribution:
152152

153153
```bash
154-
wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.7.3/spark-3.2.1-bin-openmldbspark.tgz
154+
wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.0/spark-3.2.1-bin-openmldbspark.tgz
155155
```
156156

157157
Alternatively, you can also download the source code and compile from scratch:

docs/en/deploy/install_deploy.md

Lines changed: 25 additions & 25 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@
99
* The number of cores is recommended to be no less than 4 cores. If the CPU does not support the AVX2 instruction set in the Linux environment, the deployment package needs to be recompiled from the source code.
1010

1111
## Deployment Package
12-
The precompiled OpenMLDB deployment package is used by default in this documentation ([Linux](https://github.com/4paradigm/OpenMLDB/releases/download/v0.7.3/openmldb-0.7.3-linux.tar.gz) , [macOS](https://github.com/4paradigm/OpenMLDB/releases/download/v0.7.3/openmldb-0.7.3-darwin.tar.gz)), the supported operating system requirements are: CentOS 7, Ubuntu 20.04, macOS >= 10.15. If the user wishes to compile by himself (for example, for OpenMLDB source code development, the operating system or CPU architecture is not in the support list of the precompiled deployment package, etc.), the user can choose to compile and use in the docker container or compile from the source code. For details, please refer to our [compile documentation](compile.md).
12+
The precompiled OpenMLDB deployment package is used by default in this documentation ([Linux](https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz) , [macOS](https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-darwin.tar.gz)), the supported operating system requirements are: CentOS 7, Ubuntu 20.04, macOS >= 10.15. If the user wishes to compile by himself (for example, for OpenMLDB source code development, the operating system or CPU architecture is not in the support list of the precompiled deployment package, etc.), the user can choose to compile and use in the docker container or compile from the source code. For details, please refer to our [compile documentation](compile.md).
1313

1414
## Configure Environment (Linux)
1515

@@ -91,9 +91,9 @@ OpenMLDB standalone version needs to deploy a nameserver and a tablet. The names
9191
### Download the OpenMLDB Release Package
9292

9393
```
94-
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.7.3/openmldb-0.7.3-linux.tar.gz
95-
tar -zxvf openmldb-0.7.3-linux.tar.gz
96-
cd openmldb-0.7.3-linux
94+
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz
95+
tar -zxvf openmldb-0.8.0-linux.tar.gz
96+
cd openmldb-0.8.0-linux
9797
```
9898

9999
### Configuration
@@ -163,9 +163,9 @@ Environment Requirements:
163163
### Download the OpenMLDB Deployment Package
164164

165165
```
166-
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.7.3/openmldb-0.7.3-linux.tar.gz
167-
tar -zxvf openmldb-0.7.3-linux.tar.gz
168-
cd openmldb-0.7.3-linux
166+
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz
167+
tar -zxvf openmldb-0.8.0-linux.tar.gz
168+
cd openmldb-0.8.0-linux
169169
```
170170

171171
### Configuration
@@ -175,7 +175,7 @@ which are listed below.
175175

176176
| Environment Variables | Default Values | Definitons |
177177
|-----------------------------------|---------------------------------------------------------|-------------------------------------------------------------------------------------------------------|
178-
| OPENMLDB_VERSION | 0.7.3 | OpenMLDB version |
178+
| OPENMLDB_VERSION | 0.8.0 | OpenMLDB version |
179179
| OPENMLDB_MODE | standalone | standalone or cluster mode |
180180
| OPENMLDB_HOME | root directory of the release folder | openmldb root path |
181181
| SPARK_HOME | $OPENMLDB_HOME/spark | the root path of openmldb spark release. if not exists, download from online |
@@ -311,10 +311,10 @@ Deploy the Zookeeper cluster [refer to here](https://zookeeper.apache.org/doc/r3
311311
#### 1. Download the OpenMLDB Deployment Package
312312

313313
```
314-
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.7.3/openmldb-0.7.3-linux.tar.gz
315-
tar -zxvf openmldb-0.7.3-linux.tar.gz
316-
mv openmldb-0.7.3-linux openmldb-tablet-0.7.3
317-
cd openmldb-tablet-0.7.3
314+
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz
315+
tar -zxvf openmldb-0.8.0-linux.tar.gz
316+
mv openmldb-0.8.0-linux openmldb-tablet-0.8.0
317+
cd openmldb-tablet-0.8.0
318318
```
319319

320320
#### 2. Modify the Configuration File: conf/tablet.flags
@@ -361,10 +361,10 @@ Repeat the above steps to deploy multiple tablets.
361361
#### 1. Download the OpenMLDB Deployment Package
362362

363363
```
364-
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.7.3/openmldb-0.7.3-linux.tar.gz
365-
tar -zxvf openmldb-0.7.3-linux.tar.gz
366-
mv openmldb-0.7.3-linux openmldb-ns-0.7.3
367-
cd openmldb-ns-0.7.3
364+
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz
365+
tar -zxvf openmldb-0.8.0-linux.tar.gz
366+
mv openmldb-0.8.0-linux openmldb-ns-0.8.0
367+
cd openmldb-ns-0.8.0
368368
```
369369

370370
#### 2. Modify the Configuration File: conf/nameserver.flags
@@ -411,10 +411,10 @@ Before running, make sure that the OpenMLDB cluster has been started, otherwise
411411
#### 1. Download the OpenMLDB Deployment Package
412412

413413
```
414-
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.7.3/openmldb-0.7.3-linux.tar.gz
415-
tar -zxvf openmldb-0.7.3-linux.tar.gz
416-
mv openmldb-0.7.3-linux openmldb-apiserver-0.7.3
417-
cd openmldb-apiserver-0.7.3
414+
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz
415+
tar -zxvf openmldb-0.8.0-linux.tar.gz
416+
mv openmldb-0.8.0-linux openmldb-apiserver-0.8.0
417+
cd openmldb-apiserver-0.8.0
418418
```
419419

420420
#### 2. Modify the Configuration File: conf/apiserver.flags
@@ -454,12 +454,12 @@ TaskManager can be deployed in single server. You can deploy multiple instances
454454
#### 1. Download the OpenMLDB Spark Distribution that is Optimized for Feature Engineering
455455

456456
```
457-
wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.7.3/spark-3.2.1-bin-openmldbspark.tgz
457+
wget https://github.com/4paradigm/spark/releases/download/v3.2.1-openmldb0.8.0/spark-3.2.1-bin-openmldbspark.tgz
458458
tar -zxvf spark-3.2.1-bin-openmldbspark.tgz
459-
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.7.3/openmldb-0.7.3-linux.tar.gz
460-
tar -zxvf openmldb-0.7.3-linux.tar.gz
461-
mv openmldb-0.7.3-linux openmldb-taskmanager-0.7.3
462-
cd openmldb-taskmanager-0.7.3
459+
wget https://github.com/4paradigm/OpenMLDB/releases/download/v0.8.0/openmldb-0.8.0-linux.tar.gz
460+
tar -zxvf openmldb-0.8.0-linux.tar.gz
461+
mv openmldb-0.8.0-linux openmldb-taskmanager-0.8.0
462+
cd openmldb-taskmanager-0.8.0
463463
```
464464

465465
#### 2. Modify the Configuration File conf/taskmanager.properties

docs/en/quickstart/java_sdk.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -9,12 +9,12 @@ Configure maven pom
99
<dependency>
1010
<groupId>com.4paradigm.openmldb</groupId>
1111
<artifactId>openmldb-jdbc</artifactId>
12-
<version>0.7.3</version>
12+
<version>0.8.0</version>
1313
</dependency>
1414
<dependency>
1515
<groupId>com.4paradigm.openmldb</groupId>
1616
<artifactId>openmldb-native</artifactId>
17-
<version>0.7.3</version>
17+
<version>0.8.0</version>
1818
</dependency>
1919
```
2020
### Package Installation on Mac
@@ -24,15 +24,15 @@ Configure maven pom
2424
<dependency>
2525
<groupId>com.4paradigm.openmldb</groupId>
2626
<artifactId>openmldb-jdbc</artifactId>
27-
<version>0.7.3</version>
27+
<version>0.8.0</version>
2828
</dependency>
2929
<dependency>
3030
<groupId>com.4paradigm.openmldb</groupId>
3131
<artifactId>openmldb-native</artifactId>
32-
<version>0.7.3-macos</version>
32+
<version>0.8.0-macos</version>
3333
</dependency>
3434
```
35-
Note that since `openmldb-native` contains the C++ static library compiled by OpenMLDB, by default it is a Linux's static library. On macOS, the version of the above openmldb-native needs to be changed to `0.7.3-macos`, and the version of openmldb-jdbc remains unchanged.
35+
Note that since `openmldb-native` contains the C++ static library compiled by OpenMLDB, by default it is a Linux's static library. On macOS, the version of the above openmldb-native needs to be changed to `0.8.0-macos`, and the version of openmldb-jdbc remains unchanged.
3636

3737
The macOS native relase only supports macos-12. If you want use in macos-11 or macos 10.15, you should build openmldb-native from source in macos-11/macos-10.15, see [Build Java SDK](../deploy/compile.md#build-java-sdk-with-multi-processes) for details.
3838

docs/en/quickstart/openmldb_quickstart.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ If you wan to compile and install it by yourself, you can refer to our [installa
1717
Pull the image (image download size is about 1GB, after decompression is about 1.7 GB) and start the docker container:
1818

1919
```bash
20-
docker run -it 4pdosc/openmldb:0.7.3 bash
20+
docker run -it 4pdosc/openmldb:0.8.0 bash
2121
```
2222

2323
```{important}

docs/en/reference/ip_tips.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -38,12 +38,12 @@ Expose the port through `-p` when starting the container, and the client can acc
3838

3939
The stand-alone version needs to expose the ports of three components (nameserver, tabletserver, apiserver):
4040
```
41-
docker run -p 6527:6527 -p 9921:9921 -p 8080:8080 -it 4pdosc/openmldb:0.7.3 bash
41+
docker run -p 6527:6527 -p 9921:9921 -p 8080:8080 -it 4pdosc/openmldb:0.8.0 bash
4242
```
4343

4444
The cluster version needs to expose the zk port and the ports of all components:
4545
```
46-
docker run -p 2181:2181 -p 7527:7527 -p 10921:10921 -p 10922:10922 -p 8080:8080 -p 9902:9902 -it 4pdosc/openmldb:0.7.3 bash
46+
docker run -p 2181:2181 -p 7527:7527 -p 10921:10921 -p 10922:10922 -p 8080:8080 -p 9902:9902 -it 4pdosc/openmldb:0.8.0 bash
4747
```
4848

4949
```{tip}
@@ -57,7 +57,7 @@ If the OpenMLDB service process is distributed, the "port number is occupied" ap
5757
#### Host Network
5858
Or more conveniently, use host networking without port isolation, for example:
5959
```
60-
docker run --network host -it 4pdosc/openmldb:0.7.3 bash
60+
docker run --network host -it 4pdosc/openmldb:0.8.0 bash
6161
```
6262
But in this case, it is easy to find that the port is occupied by other processes in the host. If occupancy occurs, change the port number carefully.
6363

0 commit comments

Comments
 (0)