B.Versant数据库与非结构化海量数据存储及应用案例-Robert+Greene.ppt

1、Versant数据库与非结构化海量数据存储及应用案例,Versant Database in Non-Structural, SQL/NO-SQL, Big Data Applications,Robert Greene Vice President Technology Versant Co. Ltd.,Agenda,Who is Versant What is the Technology Why it is Chosen Customer Examples Technology,Hamburg,Shanghai,Redwood City, CA,Bangalore,Innovator o

2、f high performance databases since 1988 Stock Exchange (NASDAQ:VSNT) since 1996 Global Presence 4 major locations Redwood City, California Hamburg, Germany Shanghai, China Bangalore, India Worldwide installations including: Telecommunications, Defense, Financial Services, Transportation, Manufacturi

3、ng, other.,Who is Versant,Versant Big Data and the Cloud,Data Volume Volume Complexity Speed Changing analysis model,Agenda,Who is Versant What is the Technology Why it is Chosen Customer Examples Technology,What is the Technology,A complete object oriented approach to scalable, extreme performance

4、Cloud Database data management,Distributed, Clustered, Parallel, Fault Tolerant,Compute Node 2,Compute Node 3,Compute Node 4,ComputeNode 1,ComputeNode ,Parallel Thread Execution On Compute Nodes,Versant,Versant,Transparent Data Distribution / Data Balancing,The Better NoSQL,. find by key( ) + a lot

5、of custom application code,.find by key( ) or select from where operators + JPA,VSNT =,partition key:graph,connected,disconnected,Object Database Industry Leadership,Versant Performance vs. RDBMS,performance improvement,50 x 30 x 10 x 5x 3x,Complexity level of Data Model for transactions,Simple Quer

6、ies Complex transactions,Simple,Complex,ING Barings Risk Management,CIBC Global Markets Front Office Trading,IBM Benchmark,Medium,Ericsson Network Management,Verizon Fraud Management,British Airways Yield Management,52x faster,32x faster,35x faster,85x faster,10-50 x faster,15x faster,Agenda,Who is

7、Versant What is the Technology Why it is Chosen Customer Examples Technology,Why is it chosen,Handles model complexity of modern business Benchmarked significantly Faster than competition Designed to Scale with a modern architecture Provides high QoS up time ( 99.9999 Availability ) Provides extreme

8、 operational Efficiency,Versant Customers,Agenda,Why it is Chosen Example Customer,The Challenge at ESA: Planck,Complex Big Data Captured Analyzed Shared,X=4329832809458930458099853,Y=348328409328,ANALYSIS SEQUENCE /,Technology Selection Complexity,Key Versant Benefits Persistence of compute schema

9、as storage schema (no mapping) Supporting data connectivity across physical database nodes,Object Oriented Analysis Distributed Address Database, Ready to Get Deployed on Cloud Computing Environment Multiple Layers/Tiers, Multiple Data Connections, Multiple Calculation Models; Ready to Get Deployed

10、with GIS.,How,Why it is Chosen Extreme performance,Model driven, not data driven NoSQL based design Data relationships established mostly once Relationships semi-static, changing infrequently Data values are what change often Eliminated need for slow JOIN operations RDB JOIN is runtime relationship

11、calculation Terrible for richly linked, unstructured and growing data Versant stores relationship natively, so no JOIN Query on relations, but no runtime calculation of relations,How does it achieve better performance,SabreSonic Inventory,Inventory Manager 90K in production complex read transactions

12、 per second 500 write transactions per second Claims - highest business transaction processing system in world Chose Versant for: Huge performance advantage Availability processor caches entire database in server farms, transacts to disk Uses CORBA messaging for refresh of changed objects Cloud test

13、ing at SUN labs achieved 150K txn/sec on 14 node cluster Reliability 5 nines reliability using our Fault Tolerant Server Online backup and no need for offline rebuilds,Quantel Pablo Platform,How,Why it is Chosen Big Data Scalability and Cloud Distribution,How does it handle cloud scalability-virtual

14、 data store-,Objects may be partitioned into any database in network and can reference any other object in any other database and you can move them freely from database to database Allows for efficient partitioning and parallelization of access Data store is now scalable and it is easy to minimize n

15、etwork traffic Allows for locality performance gains,Verizon - Sheriff Architecture,file:/E:/p0007.gif,Verizon - System Highlights,Transactions in a 12 hour period 1.8B events inserted into the database size of transaction 550 bytes 5 million cases built size of transaction 3K bytes Hardware configu

16、ration Dell x86 Linux Servers EMC Disk Array Veritas file system with stripped raw devices,How,Why it is Chosen High Reliability, Always On System,How does it achieve its availability,Synchronous fault tolerant replication Asynchronous master-slave, peer-peer replication Hardware integrations for ac

17、tive-passive availability Visual and API online administration,Real-time GIS Support in Battle Field Management,Thales - Field Battle Management System; Fast & Applied to Multiple Simulation Models.,How,Why it is Chosen Operational Efficiency lower cost of cloud,Extreme Operational Efficiencies-stor

18、age-,Save greater than 50% in disk storage No duplicate data for JOINs No excessive indexes to rebuild relations No duplicate data for performance optimization (de-normalization ),European Space Agency Planck Study,Extreme Operational Efficiencies-CPU-,Save up to 50% in server capacity No CPU intens

19、ive mapping processing in mid tier No CPU intensive JOIN operations in database server,* enJin is an application server branded packaging of Versant,IBM study,Versant ExxonMobil EMPower,ExxonMobil uses the Versant database for its reservoir simulation system. This system is used to evaluate geologic

20、al information and answer key questions such as: Where to place wells When to bring on line When & where to inject fluids The performance and object orientation of the Versant database is a perfect fit for real time simulation and modeling systems.,Game Logic Server,Chat,Player Actions,A.I.,Action &

21、 Response Multiplexor,Client-specific game “world views”,Game World,Client,Client,Client,Client,UniversalC - Gundam Online,Publisher: Bandai, Developed by DIMPS 1 billion objects in the game world at the start Integration of multiple game shards on one single cluster provides capacity for more than

22、100,000 concurrent users in a single game space (Supra-Multiple-Player-Connection possible),Game Logic Server,Gundam Implementation,Production event numbers 35,000 concurrent users 28 CPUs, 40G RAM,Agenda,Who is Versant What is the Technology Why it is Chosen Where it Matters,Where it matters for Cloud,It is crystal clear traditional relational databases are failing under the modern demands of complexity, concurrency and large data volume It is equally clear modern information model complexity needs more than a key:value stor