product description · visualized graph analysis provides a wizard-based exploration environment...

Graph Engine Service

Product Description

Issue 1.0

Date 2020-04-13

HUAWEI TECHNOLOGIES CO., LTD.

Copyright © Huawei Technologies Co., Ltd. 2020. All rights reserved.

No part of this document may be reproduced or transmitted in any form or by any means without priorwritten consent of Huawei Technologies Co., Ltd. Trademarks and Permissions

and other Huawei trademarks are trademarks of Huawei Technologies Co., Ltd.All other trademarks and trade names mentioned in this document are the property of their respectiveholders. NoticeThe purchased products, services and features are stipulated by the contract made between Huawei andthe customer. All or part of the products, services and features described in this document may not bewithin the purchase scope or the usage scope. Unless otherwise specified in the contract, all statements,information, and recommendations in this document are provided "AS IS" without warranties, guaranteesor representations of any kind, either express or implied.

The information in this document is subject to change without notice. Every effort has been made in thepreparation of this document to ensure accuracy of the contents, but all statements, information, andrecommendations in this document do not constitute a warranty of any kind, express or implied.

Issue 1.0 (2020-04-13) Copyright © Huawei Technologies Co., Ltd. i

Contents

1 What Is GES?.............................................................................................................................1

2 Product Advantages................................................................................................................ 3

3 Applicable Scenarios............................................................................................................... 4

4 Basic Concepts.......................................................................................................................... 7

5 Restrictions................................................................................................................................8

6 Permissions Management..................................................................................................... 9

7 Related Services.....................................................................................................................15

8 Quotas......................................................................................................................................16

9 Billing....................................................................................................................................... 17

Graph Engine ServiceProduct Description Contents

Issue 1.0 (2020-04-13) Copyright © Huawei Technologies Co., Ltd. ii

1 What Is GES?

Graph Engine Service (GES) facilitates querying and analysis of graph-structuredata based on various relationships. It is specifically suited for scenarios requiringanalysis of rich relationship data, including social relationship analysis, marketingrecommendation, public opinions and social listening, information communication,and anti-fraud.

Functions

GES has the following functions:

● Extensive AlgorithmsSupports the PageRank, K-Core, Shortest Path, Label Propagation, TriangleCount, and Link Prediction algorithms.

● Visualized Graph AnalysisProvides a wizard-based exploration environment and visualized query results.

● Query/Analysis APIsProvides APIs for graph query, metrics statistics, Gremlin query, graphalgorithms, and graph and backup management.

● Good CompatibilityCompatible with open source Apache TinkerPop Gremlin 3.3.0.

● Graph ManagementProvides the GES overview, graph management, graph backup, and metadatamanagement functions.

Accessing GES

A web-based management console on HUAWEI CLOUD and HTTPS-basedApplication Programming Interfaces (APIs) are available for accessing GES.

● Using APIsIf you need to integrate GES on the cloud platform into a third-party systemfor secondary development, use APIs to access the service. For details, see theGraph Engine Service API Reference.

● Using the management console

Graph Engine ServiceProduct Description 1 What Is GES?

Issue 1.0 (2020-04-13) Copyright © Huawei Technologies Co., Ltd. 1

https://support.huaweicloud.com/en-us/api-ges/ges_03_0001.html

To perform other operations, access the GES using the management console.If you have registered with the cloud, choose Enterprise Intelligence >Essential Platform > Graph Engine Service from the main page and log into the GES management console. If you have not registered, view Registeringon the HUAWEI CLOUD Management Console to register an account.

Graph Engine ServiceProduct Description 1 What Is GES?


https://support.huaweicloud.com/en-us/qs-consolehome/en-us_topic_0016739341.html

https://support.huaweicloud.com/en-us/qs-consolehome/en-us_topic_0016739341.html

2 Product Advantages

Large ScaleEfficient data organization facilitates analysis and querying of graphs with tens ofbillions of vertices and hundreds of billions of edges.

High PerformanceOptimized distributed graph processing engine supports high-concurrency, multi-hop, real-time queries in seconds.

Integrated Querying and AnalysisIntegrated querying and analysis and graph analytics algorithms facilitate analysisfor scenarios such as relationship analysis, route planning, and marketingrecommendation.

Ease of UseWizard-based GUI and compatibility with Gremlin facilitate easy graph analysis.

Graph Engine ServiceProduct Description 2 Product Advantages


3 Applicable Scenarios

GES is perfect but not limited to scenarios such as Internet, knowledge graph,financial risk control, urban industry, and enterprise IT applications.

Internet

Quickly and effectively mines valuable information from large and complex socialnetworks in the mobile Internet era.

In this scenario, GES will help you implement the following functions:

● Friend, Product, and Information RecommendationProvides personalized and precise recommendations based on friendrelationships, user profiles, behavior similarities, product similarities, andpropagation paths.

● User GroupingGroups users based on their profiles, behavior similarities, or relationships tofacilitate precise user group management.

● Abnormal Behavior AnalysisAnalyzes user behavior, partner relationships, and account/IP logininformation to detect abnormal behavior, minimizing losses due to frauds.

● Public Opinion and Social ListeningIdentifies opinion leaders and hot topics by analyzing propagation paths andrelationships, enhancing the quality of public opinion analysis.

Knowledge Graph

GES-based knowledge graphs integrate various kinds of heterogeneous data,enabling larger graph scales and higher performance.


● Massive StorageIntegrates and stores billions of heterogeneous data points as vertices andedges in graphs.

● Quick Correlation Query

Graph Engine ServiceProduct Description 3 Applicable Scenarios


Optimized to process thousands of graph queries, returning accurate resultswithin seconds.

● Knowledge ClassificationCombines similar knowledge points based on graph-based analysis andcomputing to implement knowledge disambiguation.

● Learning Path Identification and RecommendationIdentifies and recommends learning paths based on learning relationshipsbetween data points.

Financial Risk ControlGES graph queries help detect fraudulent user behavior, minimizing potentialfinancial risks.


● Real-Time Fraud DetectionIdentifies users who share the same personal information such as emailaddresses or IP addresses and highlights cases of known or potential fraud.

● Group DetectionGroups users based on interpersonal relationship analysis to identifyabnormal groups.

● Missing Person TrackingTracks the missing person based on various relationships.

Urban IndustryHelps customers adjust the pressure and balance loads of urban roads or pipelines(such as water, gas, power, and oil pipelines) to facilitate refined control overtraffic networks and pipelines.


● Pipeline Pressure AdjustmentHelps analyze traffic pressure of the entire pipeline network based on thereal-time pipeline monitoring data.

● Urban Road Network ControlAnalyzes traffic congestion of the entire urban road network according to thetraffic, road network, and intersection monitoring information to improvetraffic light control.

● Route PlanningHelps plan routes based on people and vehicle requests in real time,increasing the seat occupancy rate and reducing operation costs.

Enterprise ITProvides intelligent device monitoring and management for your entire networkand IT infrastructure.




● Network PlanningFacilitates network planning by determining impacts of faulty nodes, andrecommends backup routers for nodes bearing the heaviest loads.

● Fault Cause AnalysisQuickly locates the root cause of any network or infrastructure fault.

● IT Infrastructure ManagementProvides visual relationships of network devices, including device and resourcestatuses, for more efficient O&M.



4 Basic Concepts

VertexVertices represent entities in data models, such as vehicles in traffic networks,stations in communication networks, users and commodities in e-commercetransaction networks, and web pages on the Internet.

EdgeEdges represent relationships in data models, such as friend relationships in socialnetworks, user ratings and purchase behavior in e-commerce transactionnetworks, cooperative relationships between authors of papers, and indexrelationships between articles.

GremlinGremlin is a graph traversal language in the open source graph calculationframework of Apache TinkerPop. You can use Gremlin to create, read, update, anddelete (CRUD) data. For example, you can use Gremlin to load data, managegraphs, and compile complex traversing algorithms.

Graph Engine ServiceProduct Description 4 Basic Concepts


5 Restrictions

Browser VersionsYou are advised to use the following browsers:● Google Chrome 43.0 or later● Mozilla Firefox 43.0 or later● Internet Explorer 9.0 or later

If you use Internet Explorer 9.0, you may fail to log in to the GES management consolebecause user administrator is disabled by default in some Windows versions, such asWindows 7 Ultimate. The Internet Explorer automatically selects another user duringinstallation, such as user system. As a result, you cannot use the Internet Explorer toaccess the GES management console. Reinstall Internet Explorer 9.0 or later(recommended) or try to run Internet Explorer 9.0 as user administrator.

Graph Engine ServiceProduct Description 5 Restrictions


6 Permissions Management

If you need to assign different permissions to employees in your enterprise toaccess your GES resources, Identity and Access Management (IAM) is a goodchoice for fine-grained permissions management. IAM provides identityauthentication, permissions management, and access control, helping you secureaccess to your HUAWEI CLOUD resources.

With IAM, you can use your HUAWEI CLOUD account to create IAM users for youremployees, and assign permissions to the users to control their access to specificresource types. For example, some software developers in your enterprise need touse GES resources but must not delete them or perform any high-risk operations.To achieve this result, you can create IAM users for the software developers andgrant them only the permissions required for using GES resources.

If your HUAWEI CLOUD account does not need individual IAM users forpermissions management, you may skip over this chapter.

IAM can be used free of charge. You pay only for the resources in your account.For more information about IAM, see IAM Service Overview.

GES PermissionsBy default, new IAM users do not have permissions assigned. You need to add theusers to one or more groups, and attach permissions policies or roles to thesegroups. The users then inherit permissions from the groups to which they areadded. After authorization, the users can perform specified operations on GESbased on the permissions.

GES is a project-level service deployed and accessed in specific physical regions. Toassign GES permissions to a user group, specify the scope as region-specificprojects and select projects for the permissions to take effect. If All projects isselected, the permissions will take effect for the user group in all region-specificprojects. When accessing GES, the users need to switch to a region where theyhave been authorized to use GES.

● Type: There are roles and policies.– Roles: A type of coarse-grained authorization mechanism that defines

permissions related to user responsibilities. This mechanism provides onlya limited number of service-level roles for authorization. When usingroles to grant permissions, you need to also assign other roles on which

Graph Engine ServiceProduct Description 6 Permissions Management


https://support.huaweicloud.com/en-us/productdesc-iam/iam_01_0026.html

the permissions depend to take effect. However, roles are not an idealchoice for fine-grained authorization and secure access control.

– Policies: A type of fine-grained authorization mechanism that definespermissions required to perform operations on specific cloud resourcesunder certain conditions. This mechanism allows for more flexible policy-based authorization, meeting requirements for secure access control. Forexample, you can grant GES users only the permissions for managing acertain type of cloud servers. For the API actions supported by GES, seePermissions Policies and Supported Actions.

● Dependencies: HUAWEI CLOUD services interact with each other. Therefore, ifa GES policy depends on the policies of other services, the permissions of GEStake effect only after the dependent policies are granted to users. For details,see Table 6-1 and Table 6-2.

Because of the cache, it takes about 13 minutes for an OBS role to take effect after beinggranted to users and user groups. After a policy is granted, it takes about 5 minutes to takeeffect.

Table 6-1 GES roles

Role Name Description

Tenant Guest Common tenant users● Permissions: querying GES resources● Scope: project-level service

GES Administrator GES administrator● Permissions: performing any operations on GES

resources● Scope: project-level serviceNOTE

If you have the GES Administrator, Tenant Guest, and ServerAdministrator permissions, you can perform any operations onGES resources. If you do not have the Tenant Guest or ServerAdministrator permissions, you cannot use GES properly.● To bind or unbind an EIP, you must have the Security

Administrator permissions to create agencies.● To interact with OBS, such as creating a graph and importing

data, you must have the Tenant Administrator permissionsof OBS. For details, see Table 6-5.



https://support.huaweicloud.com/en-us/api-ges/ges_03_0148.html

Role Name Description

GES Manager GES manager● Permissions: performing any operations on GES

resources other than creating and deleting graphs.● Scope: project-level serviceNOTE

If you have both the GES Manager and Tenant Guestpermissions, you can perform any operations on GES resourcesexcept for creating and deleting graphs. If you do not have theTenant Guest permissions, you cannot use GES properly.● To bind or unbind an EIP, you must have the Security

Administrator and Server Administrator permissions.● To interact with OBS, such as importing data, you must have

the OBS permissions. For details, see Table 6-5.

GES Operator GES common users● Permissions: viewing and accessing GES resources● Scope: project-level serviceNOTE

If you have both the GES Operator and Tenant Guestpermissions, you can view and access GES resources. If you donot have the Tenant Guest permissions, you cannot viewresources or access graphs.To interact with OBS, such as viewing the metadata, you musthave the OBS permissions. For details, see Table 6-5.

Table 6-2 GES policies

PolicyName

Description

GESFullAccess

Administrator permissions for GES. Users granted thesepermissions can perform all operations on GES, including creating,deleting, accessing, and updating graphs.NOTE

● To bind or unbind an EIP, the users must have the SecurityAdministrator permissions to create agencies.

● To interact with OBS, such as creating a graph and importing data, theusers must have the OBS permissions. For details, see Table 6-5.

GESDevelopment

Use permissions for GES. Users granted these permissions canperform any operations on GES except for graph creation anddeletion.NOTE

● To bind or unbind an EIP, the users must have the SecurityAdministrator and Server Administrator permissions.

● To interact with OBS, such as creating a graph and importing data, theusers must have the OBS permissions. For details, see Table 6-5.



PolicyName

Description

GESReadOnlyAccess

Read-only permissions for ECS. Users granted these permissionscan only perform resource querying operations, such as viewingthe graph list, metadata, and backups.NOTE

To interact with OBS, such as viewing the metadata, you must have theOBS permissions. For details, see Table 6-5.

Table 6-3 Common GES operations supported by each role

Operation GESAdministrator

GESManager

GESOperator

TenantGuest

Creating graphs √ × × ×

Deleting graphs √ × × ×

Querying graphs √ √ √ √

Accessing graphs √ √ √ ×

Importing data √ √ × ×

Creating metadata √ √ × ×

Viewing metadata √ √ √ √

Copying metadata √ √ × ×

Editing metadata √ √ × ×

Deleting metadata √ √ × ×

Clearing data √ √ × ×

Backing up graphs √ √ × ×

Loading backups √ √ × ×

Deleting backups √ √ × ×

Viewing backups √ √ √ √

Starting graphs √ √ × ×

Stopping graphs √ √ × ×

Upgrading graphs √ √ × ×

Exporting graphs √ √ × ×

Binding EIPs √ √ × ×

Unbinding EIPs √ √ × ×



Operation GESAdministrator

GESManager

GESOperator

TenantGuest

Viewing results in theTask Center

√ √ √ √

Table 6-4 Common GES operations supported by each policy

Operation GESFullAccess

GESDevelopment

GESReadOnlyAccess

Resource

Querying thegraph list

√ √ √ -

Querying graphdetails

√ √ √ graphName

Creating graphs √ x x graphName

Accessing graphs √ x x graphName

Stopping graphs √ √ x graphName

Starting graphs √ √ x graphName

Deleting graphs √ x x graphName

Incrementallyimporting datato graphs

√ √ x graphName

Exporting graphs √ √ x graphName

Clearing graphs √ √ x graphName

Upgradinggraphs

√ √ x graphName

Binding EIPs √ √ x graphName

Unbinding EIPs √ √ x graphName

Viewing the listof all backups

√ √ √ -

Viewing thebackup list of agraph

√ √ √ -

Adding backups √ √ x backupName

Deleting backups √ √ x backupName



Operation GESFullAccess

GESDevelopment

GESReadOnlyAccess

Resource

Querying themetadata list

√ √ √ -

Queryingmetadata

√ √ √ metadataName

Verifyingmetadata

√ √ x -

Adding metadata √ √ x metadataName

Deletingmetadata

√ √ x metadataName

Querying taskstatus

√ √ √ -

Querying thetask list

√ √ √ -

Table 6-5 Common GES operations supported by each OBS policy

GES Operation Dependent OBS Permission

Viewing metadata OBS Viewer policy or OBS Buckets Viewer role

Creating/Importing/Copying/Editing/Deletingmetadata

OBS Operator policy or Tenant Administrator role

Creating a graph (withinitial data), andimporting or exporting thegraph

OBS Operator policy or Tenant Administrator role

Helpful Links● IAM Service Overview● Creating a User and Granting Permissions



https://support.huaweicloud.com/en-us/productdesc-iam/iam_01_0026.html

https://support.huaweicloud.com/en-us/usermanual-ges/ges_01_0069.html

7 Related Services

IAMIdentity and Access Management (IAM) authenticates access to GES on HUAWEICLOUD.

VPCGES uses Virtual Private Cloud (VPC) to provide clusters with network topologiesto isolate clusters and control access.

OBSGES stores graph data on Object Storage Service (OBS), satisfying therequirements for secure, reliable, and cost-effective storage.● When creating a graph, obtain the vertex and edge data sets from OBS

buckets. In addition, you can use OBS buckets to store logs.● When incrementally importing data to a graph on the Graph Management

page, obtain the data from OBS buckets. You can also export graph data toOBS buckets.

● On the page for creating metadata files, select an OBS bucket as the datastorage path.

● You can import the metadata from a local path or an OBS bucket.

Graph Engine ServiceProduct Description 7 Related Services


8 Quotas

Quotas are enforced for service resources on the platform to prevent unforeseenspikes in resource usage. Quotas can limit the number or amount of resourcesavailable to users.

If the existing resource quota cannot meet your requirements, apply for a higherquota.

GES uses the following infrastructure resources:

● IAM● VPC● OBS

For details about how to view and increase quotas, see Quotas.

Graph Engine ServiceProduct Description 8 Quotas


https://support.huaweicloud.com/en-us/usermanual-iaas/en-us_topic_0040259342.html

9 Billing

GES billing is simple and predictable. You can either choose the pay-per-use billingmode or prepaid instance billing mode, which is more economic.

Billing ItemsIn GES, you pay for the graph size (edges), data storage space, and public networktraffic you use.

Table 9-1 GES billing items

Billing Item Description

Graph size (edges) ● You pay for the graph size (edges) you choose.● For edge billing, the per-per-use (hourly) and

prepaid instance (monthly/yearly) billing modes areavailable.

Data storage space GES data is uploaded or exported from Object StorageService (OBS), so the storage billing is based on theOBS prices. For details, see the OBS Pricing Details.

Public network traffic GES supports bindings to public IP addresses, whichare charged based on the EIP pricing rules of theVirtual Private Cloud (VPC) service. However, the GEStraffic generated inside the HUAWEI CLOUD networkwill not be charged.

For details about the GES prices, see the GES Pricing Details. You can use the GESprice calculator to quickly calculate an estimate price of a graph with your desiredsize.

Billing ModesGES provides two billing modes, that is, pay-per-use (hourly) and prepaid instance(monthly/yearly). You can choose either of them. The longer you use, the less youpay.

Graph Engine ServiceProduct Description 9 Billing


https://support.huaweicloud.com/en-us/pro_price/index.html#obs_detail

https://www.huaweicloud.com/en-us/pricing.html?tab=detail#/ges

● Pay per use (hourly)In this billing mode, you can enable or disable GES as you like. You are billedby the use duration on an hourly basis. It is applicable to customers who needto perform preliminary operation tests and Proofs-of-Concept verifications,and short-term users.

● Prepaid instance billing (monthly or yearly)– In this billing mode, you need to make one-off payment in advance. This

offers you significant discounts over pay-per-use mode and saves you34% to 47% of costs. It is applicable to customers who plan to use GESfor a long time.

– The prepaid instance is a billing concept only. You can regard it as acoupon. Purchasing prepaid instances will not have the system to creategraphs. When you are using graphs, the billing system automaticallycompares the number of valid prepaid instances you purchased with thenumber of graph instances in the same region and flavor you are using.The graph instances within the prepaid instance quantity range are notcharged and the extra graph instances are charged in pay-per-use mode.

– Prepaid instances are not bound to graph instances in use. For details, seethe following descriptions:

▪ After you purchase prepaid instances, the system will notautomatically create graph instances for you. If you have not run anyinstances, go to the GES management console to create graphinstances of the corresponding region, flavor, and quantity.

▪ If your graph instances are billed in pay-per-use mode, the billingsystem automatically identifies prepaid instances and gives youdiscount when generating the bill after you purchase prepaidinstances of the corresponding region, flavor, and quantity.

▪ If you delete existing graph instances and create new ones, yourprepaid instances can still be used by the new instances of the sameregion and node type.

● Prepaid instances are bound to a specific region. The purchased prepaid instancescan be used in the bound region only.

● Prepaid instances are bound to a specific instance flavor. Instances with differentflavors have different prepaid prices.

● Prepaid instances take effect as of the date when they are purchased andautomatically end when the validity period expires. For example, if you purchase apackage with three million-edge instances on January 1 (the package duration isone year), then the package automatically ends at the end of December 31 in theyear. Note that if you do not use the graphs within the validity period, the validityperiod will not be extended and the fee cannot be refunded. Therefore, to saveyour costs, you are advised to create graph instances immediately after purchasingprepaid instances, or purchase prepaid packages after creating graph instances.

Graph Engine ServiceProduct Description 9 Billing


product description · visualized graph analysis provides a wizard-based exploration environment...

Documents